Verified run
gpt-5.4-mini
gpt-5.4-mini-low-reasoning-p002-lexen-v1-20260614
- Rank
- 67
- Accuracy lexEN v1 · WordNet fine
- 89.49%
- Correct
- 4350 / 4861
- Actual run cost
- $1.82
- Cost / M items
- $374
Accuracy across label schemes
The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →
Model
- Display
- gpt-5.4-mini
- Requested
- gpt-5.4-mini
- Resolved
- gpt-5.4-mini-2026-03-17
- Vendor
- OpenAI
- API provider
- OpenAI
- Hosting
- cloud_api
- Source
- proprietary
- License
- n/a
- Reasoning
- low
- Model URL
- n/a
- Endpoint
- n/a
- Resolved counts
-
gpt-5.4-mini-2026-03-17: 4861
Reproducibility
- Created
- 2026-06-14T10:37:18.500343+00:00
- Run schema
- sensebench-run-v2
- Commit
- 8c6d7e13bd54721069cb8fb0fe72067a3b44ba51
- Dataset ID
- lexen
- Dataset version
- lexen-v1
- Dataset revision
- n/a
- Dataset items
- 4,861
- Dataset hash
- sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
- Prompt
- p002
- Prompt version
- 0.1.0
- Repository files
- Browse in GitHub
Runtime
- Calls
- 4861
- Total tokens
- 1,505,561
- Tokens / item
- 309.7
- Total cost
- $1.82
- Cost / M items
- $374
- Cost source
- litellm_estimate
- Elapsed
- 24.01s
- Success items
- 4,861
- Monosemous
- 0
- No candidates
- 0
- No valid vote
- 0
- Invalid votes
- 0
- Transport errors
- 0
Runner
- GitHub
- vassiliphilippov
- Name
- Vassili Philippov
- Contact
- n/a
Sampling
- Temperature
- n/a
- Top P
- n/a
- Max tokens
- 8,192
- Seed
- n/a
- Extra
-
n/a
Policy
- Votes / item
- 1
- Reasks / invalid vote
- 1
- Tie break
- earliest_vote
- Monosemous
- short_circuit
Cost And Token Breakdown
Actual recorded run cost: $1.82. Cost estimate source: litellm_estimate.
Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.
Download Raw Run Files
Run Metadata
run.json
Submitted run.json with model, dataset, prompt, policy, totals, and costs.
2.3 KB
Predictions
predictions.jsonl
One JSON record per benchmark item with candidates, votes, and correctness.
5.9 MB
Raw Calls
calls.jsonl.gz
Gzipped JSONL call log with prompts, raw outputs, token usage, and costs.
1.6 MB
Worst-Bucket Examples
But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.
Show raw prompt
user
Which numbered sense of "game" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the <t>game</t>.
Senses:
1. definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. definition=a single play of a sport or other contest | examples=the game lasted two hours
3. definition=an amusement or pastime | examples=they played word games
4. definition=animal hunted for food or sport
5. definition=(tennis) a division of play during which one player serves
6. definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all
7. definition=the flesh of wild animals that is used for food
8. definition=a secret scheme to do something (especially something underhand or illegal) | examples=they concocted a plot to discredit the governor
9. definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. definition=your occupation or line of work | examples=he's in the plumbing game
11. definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✗
WordNet 3.0 senses
-
1
a contest with rules to determine a winner
game%1:04:00:: · game.n.01
- you need four people to play this game
Selected
-
2
a single play of a sport or other contest
game%1:04:03:: · game.n.02
- the game lasted two hours
Gold lexEN
Gold Maru 2022
Gold Raganato
-
3
an amusement or pastime
game%1:04:01:: · game.n.03
- they played word games
- he thought of his painting as a game that filled his empty time
-
4
animal hunted for food or sport
game%1:05:00:: · game.n.04
-
5
(tennis) a division of play during which one player serves
game%1:28:00:: · game.n.05
-
6
(games) the score at a particular point or the score needed to win
game%1:23:00:: · game.n.06
- the game is 6 all
- he is serving for the game
-
7
the flesh of wild animals that is used for food
game%1:13:00:: · game.n.07
-
8
a secret scheme to do something (especially something underhand or illegal)
game%1:09:00:: · plot.n.01
- they concocted a plot to discredit the governor
- I saw through his little game from the start
Synonyms: plot, secret plan
-
9
the game equipment needed in order to play a particular game
game%1:06:00:: · game.n.09
- the child received several games for his birthday
-
10
your occupation or line of work
game%1:04:02:: · game.n.10
- he's in the plumbing game
- she's in show biz
Synonyms: biz
-
11
frivolous or trifling behavior
game%1:04:04:: · game.n.11
- for actors, memorizing lines is no game
- for him, life is all fun and games
They argued that the news media continually fanned the flames of emotion about the case.
Show raw prompt
user
Which numbered sense of "case" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: They argued that the news media continually fanned the flames of emotion about the <t>case</t>.
Senses:
1. definition=an occurrence of something | examples=it was a case of bad judgment
2. definition=a special set of circumstances | examples=in that event, the first possibility is excluded
3. definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | examples=the family brought suit against the landlord
4. definition=the actual state of things | examples=that was not the case
5. definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | examples=the subjects for this investigation were selected randomly
8. definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. definition=the quantity contained in a case
11. definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence
12. definition=a specific state of mind that is temporary | examples=a case of the jitters
13. definition=a person of a specified kind (usually with many eccentricities) | examples=a real character
14. definition=a specific size and style of type within a type family
15. definition=an enveloping structure or covering enclosing an animal or plant organ or part
16. definition=the housing or outer covering of something | examples=the clock has a walnut case
17. definition=the enclosing frame around a door or window opening | examples=the casings had rotted away and had to be replaced
18. definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. definition=bed linen consisting of a cover for a pillow | examples=the burglar carried his loot in a pillowcase
20. definition=a glass container used to store and display items in a shop or museum or home
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✗
WordNet 3.0 senses
-
1
an occurrence of something
case%1:11:00:: · case.n.01
- it was a case of bad judgment
- another instance occurred yesterday
Synonyms: instance, example
-
2
a special set of circumstances
case%1:26:00:: · event.n.02
- in that event, the first possibility is excluded
- it may rain in which case the picnic will be canceled
Synonyms: event
-
3
a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy
case%1:04:00:: · lawsuit.n.01
- the family brought suit against the landlord
Synonyms: lawsuit, suit, cause, causa
Gold lexEN
Gold Maru 2022
Gold Raganato
-
4
the actual state of things
case%1:09:00:: · case.n.04
-
5
a portable container for carrying several objects
case%1:06:00:: · case.n.05
- the musicians left their instrument cases backstage
-
6
a person requiring professional services
case%1:18:03:: · case.n.06
- a typical case was the suburban housewife described by a marriage counselor
-
7
a person who is subjected to experimental or other observational procedures; someone who is an object of investigation
case%1:18:02:: · subject.n.06
- the subjects for this investigation were selected randomly
- the cases that we studied were drawn from two different communities
Synonyms: subject, guinea pig
-
8
a problem requiring investigation
case%1:10:02:: · case.n.08
- Perry Mason solved the case of the missing heir
Selected
-
9
a statement of facts and reasons used to support an argument
case%1:10:01:: · case.n.09
- he stated his case clearly
-
10
the quantity contained in a case
case%1:23:00:: · case.n.10
Synonyms: caseful
-
11
nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence
case%1:10:00:: · case.n.11
Synonyms: grammatical case
-
12
a specific state of mind that is temporary
case%1:26:02:: · case.n.12
-
13
a person of a specified kind (usually with many eccentricities)
case%1:18:04:: · character.n.05
- a real character
- a strange character
Synonyms: character, eccentric, type
-
14
a specific size and style of type within a type family
case%1:10:03:: · font.n.01
Synonyms: font, fount, typeface, face
-
15
an enveloping structure or covering enclosing an animal or plant organ or part
case%1:08:00:: · sheath.n.02
Synonyms: sheath
-
16
the housing or outer covering of something
case%1:06:06:: · shell.n.08
- the clock has a walnut case
Synonyms: shell, casing
-
17
the enclosing frame around a door or window opening
case%1:06:07:: · casing.n.03
- the casings had rotted away and had to be replaced
Synonyms: casing
-
18
(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers
case%1:06:03:: · case.n.18
- for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
Synonyms: compositor's case, typesetter's case
-
19
bed linen consisting of a cover for a pillow
case%1:06:02:: · case.n.19
- the burglar carried his loot in a pillowcase
Synonyms: pillowcase, slip, pillow slip
-
20
a glass container used to store and display items in a shop or museum or home
case%1:06:01:: · case.n.20
Synonyms: display case, showcase, vitrine
It is so extended that it part of the ethos, of the unwritten rules, but followed nonetheless by this sport.
Show raw prompt
user
Which numbered sense of "rule" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: It is so extended that it part of the ethos, of the unwritten <t>rules</t>, but followed nonetheless by this sport.
Senses:
1. definition=a principle or condition that customarily governs behavior | examples=it was his rule to take a walk before breakfast
2. definition=something regarded as a normative example | examples=the convention of not naming the main character
3. definition=prescribed guide for conduct or action
4. definition=(linguistics) a rule describing (or prescribing) a linguistic practice
5. definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | examples=their principles of composition characterized all their works
6. definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
7. definition=dominance or power through legal authority | examples=France held undisputed dominion over vast areas of Africa
8. definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
9. definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
10. definition=a rule or law concerning a natural phenomenon or the function of a complex system | examples=the principle of the conservation of mass
11. definition=(mathematics) a standard procedure for solving a class of mathematical problems | examples=he determined the upper bound with Descartes' rule of signs
12. definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✓
WordNet 3.0 senses
-
1
a principle or condition that customarily governs behavior
rule%1:09:00:: · rule.n.01
- it was his rule to take a walk before breakfast
- short haircuts were the regulation
Synonyms: regulation
Gold Raganato
Selected
-
2
something regarded as a normative example
rule%1:09:01:: · convention.n.02
- the convention of not naming the main character
- violence is the rule not the exception
Synonyms: convention, normal, pattern, formula
-
3
prescribed guide for conduct or action
rule%1:10:00:: · rule.n.03
Synonyms: prescript
-
4
(linguistics) a rule describing (or prescribing) a linguistic practice
rule%1:10:01:: · rule.n.04
Synonyms: linguistic rule
-
5
a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct
rule%1:09:03:: · principle.n.01
- their principles of composition characterized all their works
Synonyms: principle
-
6
the duration of a monarch's or government's power
rule%1:28:00:: · rule.n.06
- during the rule of Elizabeth
-
7
dominance or power through legal authority
rule%1:26:00:: · dominion.n.01
- France held undisputed dominion over vast areas of Africa
- the rule of Caesar
Synonyms: dominion
-
8
directions that define the way a game or sport is to be conducted
rule%1:10:02:: · rule.n.08
- he knew the rules of chess
Gold lexEN
Gold Maru 2022
-
9
any one of a systematic body of regulations defining the way of life of members of a religious order
rule%1:10:03:: · rule.n.09
-
10
a rule or law concerning a natural phenomenon or the function of a complex system
rule%1:09:02:: · principle.n.04
- the principle of the conservation of mass
- the principle of jet propulsion
Synonyms: principle
-
11
(mathematics) a standard procedure for solving a class of mathematical problems
rule%1:09:04:: · rule.n.11
- he determined the upper bound with Descartes' rule of signs
- he gave us a general formula for attacking polynomials
Synonyms: formula
-
12
measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths
rule%1:06:00:: · rule.n.12
Synonyms: ruler
Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.
Show raw prompt
user
Which numbered sense of "part" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: <t>Part</t> of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.
Senses:
1. definition=something determined in relation to something that includes it | examples=he wanted to feel a part of something bigger than himself
2. definition=something less than the whole of a human artifact | examples=the rear part of the house
3. definition=a portion of a natural object | examples=they analyzed the river into three parts
4. definition=that which concerns a person with regard to a particular role or situation | examples=it requires vigilance on our part
5. definition=the extended spatial location of something | examples=the farming regions of France
6. definition=the actions and activities assigned to or required or expected of a person or group | examples=the function of a teacher
7. definition=an actor's portrayal of someone in a play | examples=she played the part of Desdemona
8. definition=assets belonging to or due to or contributed by an individual person or group | examples=he wanted his share in cash
9. definition=one of the portions into which something is regarded as divided and which together constitute a whole | examples=the written part of the exam
10. definition=a line of scalp that can be seen when sections of hair are combed in opposite directions | examples=his part was right in the middle
11. definition=the melody carried by a particular voice or instrument in polyphonic music | examples=he tried to sing the tenor part
12. definition=the part played by a person in bringing about a result | examples=I am proud of my contribution in advancing the project
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✗
WordNet 3.0 senses
-
1
something determined in relation to something that includes it
part%1:24:00:: · part.n.01
- he wanted to feel a part of something bigger than himself
- I read a portion of the manuscript
Synonyms: portion, component part, component, constituent
Gold lexEN
Gold Maru 2022
Gold Raganato
-
2
something less than the whole of a human artifact
part%1:06:00:: · part.n.02
- the rear part of the house
- glue the two parts together
Synonyms: portion
-
3
a portion of a natural object
part%1:17:00:: · part.n.03
- they analyzed the river into three parts
- he needed a piece of granite
Synonyms: piece
-
4
that which concerns a person with regard to a particular role or situation
part%1:09:02:: · part.n.04
- it requires vigilance on our part
- they resisted every effort on his part
-
5
the extended spatial location of something
part%1:15:00:: · region.n.01
- the farming regions of France
- religions in all parts of the world
Synonyms: region
-
6
the actions and activities assigned to or required or expected of a person or group
part%1:04:01:: · function.n.03
- the function of a teacher
- the government must do its part
Synonyms: function, office, role
-
7
an actor's portrayal of someone in a play
part%1:09:01:: · character.n.04
- she played the part of Desdemona
Synonyms: character, role, theatrical role, persona
-
8
assets belonging to or due to or contributed by an individual person or group
part%1:21:00:: · share.n.01
- he wanted his share in cash
Synonyms: share, portion, percentage
-
9
one of the portions into which something is regarded as divided and which together constitute a whole
part%1:09:00:: · part.n.09
- the written part of the exam
- the finance section of the company
Synonyms: section, division
Selected
-
10
a line of scalp that can be seen when sections of hair are combed in opposite directions
part%1:08:01:: · part.n.10
- his part was right in the middle
Synonyms: parting
-
11
the melody carried by a particular voice or instrument in polyphonic music
part%1:10:00:: · part.n.11
- he tried to sing the tenor part
Synonyms: voice
-
12
the part played by a person in bringing about a result
part%1:04:03:: · contribution.n.01
- I am proud of my contribution in advancing the project
- they all did their share of the work
Synonyms: contribution, share
Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.
Show raw prompt
user
Which numbered sense of "case" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: Part of the debate arisen in the related <t>case</t> is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.
Senses:
1. definition=an occurrence of something | examples=it was a case of bad judgment
2. definition=a special set of circumstances | examples=in that event, the first possibility is excluded
3. definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | examples=the family brought suit against the landlord
4. definition=the actual state of things | examples=that was not the case
5. definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | examples=the subjects for this investigation were selected randomly
8. definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. definition=the quantity contained in a case
11. definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence
12. definition=a specific state of mind that is temporary | examples=a case of the jitters
13. definition=a person of a specified kind (usually with many eccentricities) | examples=a real character
14. definition=a specific size and style of type within a type family
15. definition=an enveloping structure or covering enclosing an animal or plant organ or part
16. definition=the housing or outer covering of something | examples=the clock has a walnut case
17. definition=the enclosing frame around a door or window opening | examples=the casings had rotted away and had to be replaced
18. definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. definition=bed linen consisting of a cover for a pillow | examples=the burglar carried his loot in a pillowcase
20. definition=a glass container used to store and display items in a shop or museum or home
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✗
WordNet 3.0 senses
-
1
an occurrence of something
case%1:11:00:: · case.n.01
- it was a case of bad judgment
- another instance occurred yesterday
Synonyms: instance, example
Gold lexEN
Gold Maru 2022
Gold Raganato
-
2
a special set of circumstances
case%1:26:00:: · event.n.02
- in that event, the first possibility is excluded
- it may rain in which case the picnic will be canceled
Synonyms: event
-
3
a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy
case%1:04:00:: · lawsuit.n.01
- the family brought suit against the landlord
Synonyms: lawsuit, suit, cause, causa
Selected
-
4
the actual state of things
case%1:09:00:: · case.n.04
-
5
a portable container for carrying several objects
case%1:06:00:: · case.n.05
- the musicians left their instrument cases backstage
-
6
a person requiring professional services
case%1:18:03:: · case.n.06
- a typical case was the suburban housewife described by a marriage counselor
-
7
a person who is subjected to experimental or other observational procedures; someone who is an object of investigation
case%1:18:02:: · subject.n.06
- the subjects for this investigation were selected randomly
- the cases that we studied were drawn from two different communities
Synonyms: subject, guinea pig
-
8
a problem requiring investigation
case%1:10:02:: · case.n.08
- Perry Mason solved the case of the missing heir
-
9
a statement of facts and reasons used to support an argument
case%1:10:01:: · case.n.09
- he stated his case clearly
-
10
the quantity contained in a case
case%1:23:00:: · case.n.10
Synonyms: caseful
-
11
nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence
case%1:10:00:: · case.n.11
Synonyms: grammatical case
-
12
a specific state of mind that is temporary
case%1:26:02:: · case.n.12
-
13
a person of a specified kind (usually with many eccentricities)
case%1:18:04:: · character.n.05
- a real character
- a strange character
Synonyms: character, eccentric, type
-
14
a specific size and style of type within a type family
case%1:10:03:: · font.n.01
Synonyms: font, fount, typeface, face
-
15
an enveloping structure or covering enclosing an animal or plant organ or part
case%1:08:00:: · sheath.n.02
Synonyms: sheath
-
16
the housing or outer covering of something
case%1:06:06:: · shell.n.08
- the clock has a walnut case
Synonyms: shell, casing
-
17
the enclosing frame around a door or window opening
case%1:06:07:: · casing.n.03
- the casings had rotted away and had to be replaced
Synonyms: casing
-
18
(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers
case%1:06:03:: · case.n.18
- for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
Synonyms: compositor's case, typesetter's case
-
19
bed linen consisting of a cover for a pillow
case%1:06:02:: · case.n.19
- the burglar carried his loot in a pillowcase
Synonyms: pillowcase, slip, pillow slip
-
20
a glass container used to store and display items in a shop or museum or home
case%1:06:01:: · case.n.20
Synonyms: display case, showcase, vitrine
So that, by passing rounds, it is not so clear that it is an advantage.
Show raw prompt
user
Which numbered sense of "round" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: So that, by passing <t>rounds</t>, it is not so clear that it is an advantage.
Senses:
1. definition=a charge of ammunition for a single shot
2. definition=an interval during which a recurring sequence of events occurs | examples=the never-ending cycle of the seasons
3. definition=a regular route for a sentry or policeman | examples=in the old days a policeman walked a beat and knew all his people by name
4. definition=(often plural) a series of professional calls (usually in a set order) | examples=the doctor goes on his rounds first thing every morning
5. definition=the activity of playing 18 holes of golf | examples=a round of golf takes about 4 hours
6. definition=the usual activities in your day | examples=the doctor made his rounds
7. definition=(sports) a division during which one team is on the offensive
8. definition=the course along which communications spread | examples=the story is going the rounds in Washington
9. definition=a serving to each of a group (usually alcoholic) | examples=he ordered a second round
10. definition=a cut of beef between the rump and the lower leg
11. definition=a partsong in which voices follow each other; one voice starts and others join in one after another until all are singing different parts of the song at the same time | examples=they enjoyed singing rounds
12. definition=an outburst of applause | examples=there was a round of applause
13. definition=a crosspiece between the legs of a chair
14. definition=any circular or rotating mechanism | examples=the machine punched out metal circles
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✗
WordNet 3.0 senses
-
1
a charge of ammunition for a single shot
round%1:06:01:: · round.n.01
Synonyms: unit of ammunition, one shot
-
2
an interval during which a recurring sequence of events occurs
round%1:28:01:: · cycle.n.01
- the never-ending cycle of the seasons
Synonyms: cycle, rhythm
Gold lexEN
Gold Maru 2022
Gold Raganato
-
3
a regular route for a sentry or policeman
round%1:15:00:: · beat.n.01
- in the old days a policeman walked a beat and knew all his people by name
Synonyms: beat
-
4
(often plural) a series of professional calls (usually in a set order)
round%1:04:00:: · round.n.04
- the doctor goes on his rounds first thing every morning
- the postman's rounds
-
5
the activity of playing 18 holes of golf
round%1:04:03:: · round_of_golf.n.01
- a round of golf takes about 4 hours
Synonyms: round of golf
-
6
the usual activities in your day
round%1:04:01:: · round.n.06
- the doctor made his rounds
Synonyms: daily round
-
7
(sports) a division during which one team is on the offensive
round%1:28:00:: · turn.n.09
Synonyms: turn, bout
-
8
the course along which communications spread
round%1:17:00:: · round.n.08
- the story is going the rounds in Washington
Selected
-
9
a serving to each of a group (usually alcoholic)
round%1:13:01:: · round.n.09
- he ordered a second round
Synonyms: round of drinks
-
10
a cut of beef between the rump and the lower leg
round%1:13:00:: · round.n.10
-
11
a partsong in which voices follow each other; one voice starts and others join in one after another until all are singing different parts of the song at the same time
round%1:10:00:: · round.n.11
- they enjoyed singing rounds
Synonyms: troll
-
12
an outburst of applause
round%1:10:01:: · round.n.12
- there was a round of applause
-
13
a crosspiece between the legs of a chair
round%1:06:03:: · rung.n.01
Synonyms: rung, stave
-
14
any circular or rotating mechanism
round%1:06:00:: · circle.n.08
- the machine punched out metal circles
Synonyms: circle
Two related things stand out in the results of this year's poll, taken in September and early October.
Show raw prompt
user
Which numbered sense of "thing" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: Two related <t>things</t> stand out in the results of this year's poll, taken in September and early October.
Senses:
1. definition=a special situation | examples=this thing has got to end
2. definition=an action | examples=how could you do such a thing?
3. definition=a special abstraction | examples=a thing of the spirit
4. definition=an artifact | examples=how does this thing work?
5. definition=an event | examples=a funny thing happened on the way to the...
6. definition=a vaguely specified concern | examples=several matters to attend to
7. definition=a statement regarded as an object | examples=to say the same thing in other terms
8. definition=an entity that is not named specifically | examples=I couldn't tell what the thing was
9. definition=any attribute or quality considered as having its own existence | examples=the thing I like about her is ...
10. definition=a special objective | examples=the thing is to stay in bounds
11. definition=a persistent illogical feeling of desire or aversion | examples=he has a thing about seafood
12. definition=a separate and self-contained entity
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✗
WordNet 3.0 senses
-
1
a special situation
thing%1:26:00:: · thing.n.01
- this thing has got to end
- it is a remarkable thing
Gold Raganato
-
2
an action
thing%1:04:00:: · thing.n.02
- how could you do such a thing?
-
3
a special abstraction
thing%1:09:00:: · thing.n.03
- a thing of the spirit
- things of the heart
-
4
an artifact
thing%1:06:00:: · thing.n.04
- how does this thing work?
-
5
an event
thing%1:11:00:: · thing.n.05
- a funny thing happened on the way to the...
-
6
a vaguely specified concern
thing%1:09:02:: · matter.n.01
- several matters to attend to
- it is none of your affair
Synonyms: matter, affair
Gold lexEN
-
7
a statement regarded as an object
thing%1:10:00:: · thing.n.07
- to say the same thing in other terms
- how can you say such a thing?
-
8
an entity that is not named specifically
thing%1:06:01:: · thing.n.08
- I couldn't tell what the thing was
Selected
-
9
any attribute or quality considered as having its own existence
thing%1:07:00:: · thing.n.09
- the thing I like about her is ...
-
10
a special objective
thing%1:09:01:: · thing.n.10
- the thing is to stay in bounds
-
11
a persistent illogical feeling of desire or aversion
thing%1:12:00:: · thing.n.11
- he has a thing about seafood
- she has a thing about him
-
12
a separate and self-contained entity
thing%1:03:00:: · thing.n.12
Gold Maru 2022
On the side of Costa Rica only one of 22 called players reached 50 games.
Show raw prompt
user
Which numbered sense of "side" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: On the <t>side</t> of Costa Rica only one of 22 called players reached 50 games.
Senses:
1. definition=a place within a region identified relative to a center or reference location | examples=they always sat on the right side of the church
2. definition=one of two or more contesting groups | examples=the Confederate side was prepared to attack
3. definition=either the left or right half of a body | examples=he had a pain in his side
4. definition=a surface forming part of the outside of an object | examples=he examined all sides of the crystal
5. definition=an extended outer surface of an object | examples=he turned the box over to examine the bottom side
6. definition=an aspect of something (as contrasted with some other implied aspect) | examples=he was on the heavy side
7. definition=a line segment forming part of the perimeter of a plane figure | examples=the hypotenuse of a right triangle is always the longest side
8. definition=a family line of descent | examples=he gets his brains from his father's side
9. definition=a lengthwise dressed half of an animal's carcass used for food
10. definition=an opinion that is held in opposition to another in an argument or dispute | examples=there are two sides to every question
11. definition=an elevated geological formation | examples=he climbed the steep slope
12. definition=(sports) the spin given to a ball by striking it on one side or releasing it with a sharp twist
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✗
WordNet 3.0 senses
-
1
a place within a region identified relative to a center or reference location
side%1:15:02:: · side.n.01
- they always sat on the right side of the church
- he never left my side
Selected
-
2
one of two or more contesting groups
side%1:14:00:: · side.n.02
- the Confederate side was prepared to attack
Gold lexEN
Gold Maru 2022
Gold Raganato
-
3
either the left or right half of a body
side%1:08:00:: · side.n.03
- he had a pain in his side
-
4
a surface forming part of the outside of an object
side%1:15:00:: · side.n.04
- he examined all sides of the crystal
- dew dripped from the face of the leaf
Synonyms: face
-
5
an extended outer surface of an object
side%1:06:00:: · side.n.05
- he turned the box over to examine the bottom side
- they painted all four sides of the house
-
6
an aspect of something (as contrasted with some other implied aspect)
side%1:09:00:: · side.n.06
- he was on the heavy side
- he is on the purchasing side of the business
-
7
a line segment forming part of the perimeter of a plane figure
side%1:15:01:: · side.n.07
- the hypotenuse of a right triangle is always the longest side
-
8
a family line of descent
side%1:14:01:: · side.n.08
- he gets his brains from his father's side
-
9
a lengthwise dressed half of an animal's carcass used for food
side%1:13:00:: · side.n.09
Synonyms: side of meat
-
10
an opinion that is held in opposition to another in an argument or dispute
side%1:10:00:: · side.n.10
- there are two sides to every question
Synonyms: position
-
11
an elevated geological formation
side%1:17:01:: · slope.n.01
- he climbed the steep slope
- the house was built on the side of a mountain
Synonyms: slope, incline
-
12
(sports) the spin given to a ball by striking it on one side or releasing it with a sharp twist
side%1:11:00:: · english.n.04
Synonyms: English
That number was reached Friday before the game against Panama (0-2), in Rommel Fernandez.
Show raw prompt
user
Which numbered sense of "game" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: That number was reached Friday before the <t>game</t> against Panama (0-2), in Rommel Fernandez.
Senses:
1. definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. definition=a single play of a sport or other contest | examples=the game lasted two hours
3. definition=an amusement or pastime | examples=they played word games
4. definition=animal hunted for food or sport
5. definition=(tennis) a division of play during which one player serves
6. definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all
7. definition=the flesh of wild animals that is used for food
8. definition=a secret scheme to do something (especially something underhand or illegal) | examples=they concocted a plot to discredit the governor
9. definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. definition=your occupation or line of work | examples=he's in the plumbing game
11. definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✗
WordNet 3.0 senses
-
1
a contest with rules to determine a winner
game%1:04:00:: · game.n.01
- you need four people to play this game
Selected
-
2
a single play of a sport or other contest
game%1:04:03:: · game.n.02
- the game lasted two hours
Gold lexEN
Gold Maru 2022
Gold Raganato
-
3
an amusement or pastime
game%1:04:01:: · game.n.03
- they played word games
- he thought of his painting as a game that filled his empty time
-
4
animal hunted for food or sport
game%1:05:00:: · game.n.04
-
5
(tennis) a division of play during which one player serves
game%1:28:00:: · game.n.05
-
6
(games) the score at a particular point or the score needed to win
game%1:23:00:: · game.n.06
- the game is 6 all
- he is serving for the game
-
7
the flesh of wild animals that is used for food
game%1:13:00:: · game.n.07
-
8
a secret scheme to do something (especially something underhand or illegal)
game%1:09:00:: · plot.n.01
- they concocted a plot to discredit the governor
- I saw through his little game from the start
Synonyms: plot, secret plan
-
9
the game equipment needed in order to play a particular game
game%1:06:00:: · game.n.09
- the child received several games for his birthday
-
10
your occupation or line of work
game%1:04:02:: · game.n.10
- he's in the plumbing game
- she's in show biz
Synonyms: biz
-
11
frivolous or trifling behavior
game%1:04:04:: · game.n.11
- for actors, memorizing lines is no game
- for him, life is all fun and games
Almost near the centennial number is Carles Puyol, with 97 games.
Show raw prompt
user
Which numbered sense of "number" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: Almost near the centennial <t>number</t> is Carles Puyol, with 97 games.
Senses:
1. definition=the property possessed by a sum or total or indefinite quantity of units or individuals | examples=he had a number of chores to do
2. definition=a concept of quantity involving zero and units | examples=every number has a unique position in the sequence
3. definition=a short theatrical performance that is part of a longer program | examples=he did his act three times every evening
4. definition=the number is used in calling a particular telephone | examples=he has an unlisted number
5. definition=a symbol used to represent a number | examples=he learned to write the numerals before he went to school
6. definition=one of a series published periodically | examples=she found an old issue of the magazine in her dentist's waiting room
7. definition=a select company of people | examples=I hope to become one of their number before I die
8. definition=a numeral or string of numerals that is used for identification | examples=she refused to give them her Social Security number
9. definition=a clothing measurement | examples=a number 13 shoe
10. definition=the grammatical category for the forms of nouns and pronouns and verbs that are used depending on the number of entities involved (singular or dual or plural) | examples=in English the subject and the verb must agree in number
11. definition=an item of merchandise offered for sale | examples=she preferred the black nylon number
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✗
WordNet 3.0 senses
-
1
the property possessed by a sum or total or indefinite quantity of units or individuals
number%1:07:00:: · number.n.01
- he had a number of chores to do
- the number of parameters is small
Synonyms: figure
Gold lexEN
Gold Maru 2022
Gold Raganato
-
2
a concept of quantity involving zero and units
number%1:23:00:: · number.n.02
- every number has a unique position in the sequence
Selected
-
3
a short theatrical performance that is part of a longer program
number%1:10:04:: · act.n.04
- he did his act three times every evening
- she had a catchy little routine
Synonyms: act, routine, turn, bit
-
4
the number is used in calling a particular telephone
number%1:10:03:: · phone_number.n.01
- he has an unlisted number
Synonyms: phone number, telephone number
-
5
a symbol used to represent a number
number%1:10:01:: · numeral.n.01
- he learned to write the numerals before he went to school
Synonyms: numeral
-
6
one of a series published periodically
number%1:10:00:: · issue.n.02
- she found an old issue of the magazine in her dentist's waiting room
Synonyms: issue
-
7
a select company of people
number%1:14:00:: · number.n.07
- I hope to become one of their number before I die
-
8
a numeral or string of numerals that is used for identification
number%1:10:02:: · number.n.08
- she refused to give them her Social Security number
Synonyms: identification number
-
9
a clothing measurement
number%1:07:01:: · number.n.09
-
10
the grammatical category for the forms of nouns and pronouns and verbs that are used depending on the number of entities involved (singular or dual or plural)
number%1:10:05:: · number.n.10
- in English the subject and the verb must agree in number
-
11
an item of merchandise offered for sale
number%1:06:00:: · number.n.11
- she preferred the black nylon number
- this sweater is an all-wool number
On Costa Rican side, and close to Michael Umana, are the left-lateral Junior Diaz, with 48 matches and the striker Bryan Ruiz, with 45.
Show raw prompt
user
Which numbered sense of "side" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: On Costa Rican <t>side</t>, and close to Michael Umana, are the left-lateral Junior Diaz, with 48 matches and the striker Bryan Ruiz, with 45.
Senses:
1. definition=a place within a region identified relative to a center or reference location | examples=they always sat on the right side of the church
2. definition=one of two or more contesting groups | examples=the Confederate side was prepared to attack
3. definition=either the left or right half of a body | examples=he had a pain in his side
4. definition=a surface forming part of the outside of an object | examples=he examined all sides of the crystal
5. definition=an extended outer surface of an object | examples=he turned the box over to examine the bottom side
6. definition=an aspect of something (as contrasted with some other implied aspect) | examples=he was on the heavy side
7. definition=a line segment forming part of the perimeter of a plane figure | examples=the hypotenuse of a right triangle is always the longest side
8. definition=a family line of descent | examples=he gets his brains from his father's side
9. definition=a lengthwise dressed half of an animal's carcass used for food
10. definition=an opinion that is held in opposition to another in an argument or dispute | examples=there are two sides to every question
11. definition=an elevated geological formation | examples=he climbed the steep slope
12. definition=(sports) the spin given to a ball by striking it on one side or releasing it with a sharp twist
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✗
WordNet 3.0 senses
-
1
a place within a region identified relative to a center or reference location
side%1:15:02:: · side.n.01
- they always sat on the right side of the church
- he never left my side
Selected
-
2
one of two or more contesting groups
side%1:14:00:: · side.n.02
- the Confederate side was prepared to attack
Gold lexEN
Gold Maru 2022
Gold Raganato
-
3
either the left or right half of a body
side%1:08:00:: · side.n.03
- he had a pain in his side
-
4
a surface forming part of the outside of an object
side%1:15:00:: · side.n.04
- he examined all sides of the crystal
- dew dripped from the face of the leaf
Synonyms: face
-
5
an extended outer surface of an object
side%1:06:00:: · side.n.05
- he turned the box over to examine the bottom side
- they painted all four sides of the house
-
6
an aspect of something (as contrasted with some other implied aspect)
side%1:09:00:: · side.n.06
- he was on the heavy side
- he is on the purchasing side of the business
-
7
a line segment forming part of the perimeter of a plane figure
side%1:15:01:: · side.n.07
- the hypotenuse of a right triangle is always the longest side
-
8
a family line of descent
side%1:14:01:: · side.n.08
- he gets his brains from his father's side
-
9
a lengthwise dressed half of an animal's carcass used for food
side%1:13:00:: · side.n.09
Synonyms: side of meat
-
10
an opinion that is held in opposition to another in an argument or dispute
side%1:10:00:: · side.n.10
- there are two sides to every question
Synonyms: position
-
11
an elevated geological formation
side%1:17:01:: · slope.n.01
- he climbed the steep slope
- the house was built on the side of a mountain
Synonyms: slope, incline
-
12
(sports) the spin given to a ball by striking it on one side or releasing it with a sharp twist
side%1:11:00:: · english.n.04
Synonyms: English
If you want more information on the basis of the CHMP recommendations, read the Scientific Discussion (also part of the EPAR).
Show raw prompt
user
Which numbered sense of "part" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.
Sentence: If you want more information on the basis of the CHMP recommendations, read the Scientific Discussion (also <t>part</t> of the EPAR).
Senses:
1. definition=something determined in relation to something that includes it | examples=he wanted to feel a part of something bigger than himself
2. definition=something less than the whole of a human artifact | examples=the rear part of the house
3. definition=a portion of a natural object | examples=they analyzed the river into three parts
4. definition=that which concerns a person with regard to a particular role or situation | examples=it requires vigilance on our part
5. definition=the extended spatial location of something | examples=the farming regions of France
6. definition=the actions and activities assigned to or required or expected of a person or group | examples=the function of a teacher
7. definition=an actor's portrayal of someone in a play | examples=she played the part of Desdemona
8. definition=assets belonging to or due to or contributed by an individual person or group | examples=he wanted his share in cash
9. definition=one of the portions into which something is regarded as divided and which together constitute a whole | examples=the written part of the exam
10. definition=a line of scalp that can be seen when sections of hair are combed in opposite directions | examples=his part was right in the middle
11. definition=the melody carried by a particular voice or instrument in polyphonic music | examples=he tried to sing the tenor part
12. definition=the part played by a person in bringing about a result | examples=I am proud of my contribution in advancing the project
Prediction matches gold:
lexEN ✗
Maru 2022 ✗
Raganato ✗
WordNet 3.0 senses
-
1
something determined in relation to something that includes it
part%1:24:00:: · part.n.01
- he wanted to feel a part of something bigger than himself
- I read a portion of the manuscript
Synonyms: portion, component part, component, constituent
Gold lexEN
Gold Maru 2022
Gold Raganato
-
2
something less than the whole of a human artifact
part%1:06:00:: · part.n.02
- the rear part of the house
- glue the two parts together
Synonyms: portion
Selected
-
3
a portion of a natural object
part%1:17:00:: · part.n.03
- they analyzed the river into three parts
- he needed a piece of granite
Synonyms: piece
-
4
that which concerns a person with regard to a particular role or situation
part%1:09:02:: · part.n.04
- it requires vigilance on our part
- they resisted every effort on his part
-
5
the extended spatial location of something
part%1:15:00:: · region.n.01
- the farming regions of France
- religions in all parts of the world
Synonyms: region
-
6
the actions and activities assigned to or required or expected of a person or group
part%1:04:01:: · function.n.03
- the function of a teacher
- the government must do its part
Synonyms: function, office, role
-
7
an actor's portrayal of someone in a play
part%1:09:01:: · character.n.04
- she played the part of Desdemona
Synonyms: character, role, theatrical role, persona
-
8
assets belonging to or due to or contributed by an individual person or group
part%1:21:00:: · share.n.01
- he wanted his share in cash
Synonyms: share, portion, percentage
-
9
one of the portions into which something is regarded as divided and which together constitute a whole
part%1:09:00:: · part.n.09
- the written part of the exam
- the finance section of the company
Synonyms: section, division
Gold lexEN
Gold Maru 2022
Gold Raganato
-
10
a line of scalp that can be seen when sections of hair are combed in opposite directions
part%1:08:01:: · part.n.10
- his part was right in the middle
Synonyms: parting
-
11
the melody carried by a particular voice or instrument in polyphonic music
part%1:10:00:: · part.n.11
- he tried to sing the tenor part
Synonyms: voice
-
12
the part played by a person in bringing about a result
part%1:04:03:: · contribution.n.01
- I am proud of my contribution in advancing the project
- they all did their share of the work
Synonyms: contribution, share