Verified run

Qwen/Qwen3.5-35B-A3B

vllm-qwen3.5-35b-a3b-bf16-h200-p002-lexen-v1-20260614

Rank
136
Accuracy lexEN v1 · WordNet fine
82.10%
Correct
3991 / 4861
Actual run cost
$0.0452
Cost / M items
$9.31

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 82.10% 3991 / 4861 91.73% 4459 / 4861 88.19% 4287 / 4861
Maru 2022 (ALLamended) 80.60% 3918 / 4861 91.15% 4431 / 4861 87.31% 4244 / 4861
Raganato 2017 (original) 75.58% 3674 / 4861 88.79% 4316 / 4861 84.04% 4085 / 4861

Model

Display
Qwen/Qwen3.5-35B-A3B
Requested
hosted_vllm/Qwen/Qwen3.5-35B-A3B
Resolved
Qwen/Qwen3.5-35B-A3B
Vendor
Alibaba
API provider
n/a
Hosting
self_hosted
Source
open_source
License
apache-2.0
Reasoning
n/a
Model URL
https://huggingface.co/Qwen/Qwen3.5-35B-A3B
Endpoint
http://localhost:8000/v1
Resolved counts
Qwen/Qwen3.5-35B-A3B: 4861
HF revision
59d61f3ce65a6d9863b86d2e96597125219dc754
Quantization
bf16
Inference engine
vllm
Engine version
0.22.1
Container image
vllm/vllm-openai:v0.22.1
Serve command
exec vllm serve Qwen/Qwen3.5-35B-A3B --port 8000 --served-model-name Qwen/Qwen3.5-35B-A3B --max-model-len 8192 --gpu-memory-utilization 0.90 --trust-remote-code --max-num-seqs 256 --default-chat-template-kwargs \{\"enable_thinking\":\ false\} --revision 59d61f3ce65a6d9863b86d2e96597125219dc754

Reproducibility

Created
2026-06-14T21:30:47.805630+00:00
Run schema
sensebench-run-v2
Commit
n/a
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p002
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
1,186,350
Tokens / item
244.1
Total cost
$0.0452
Cost / M items
$9.31
Cost source
machine_time_estimate
Elapsed
42.59s
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Machine & Timing

GPU
NVIDIA H200
VRAM / GPU
143,771 MiB
Driver
595.71.05
CUDA
13.2
CPU
Intel(R) Xeon(R) Platinum 8480+ (224 cores)
RAM
2,015.3 GiB
Platform
Linux-6.8.0-107-generic-x86_64-with-glibc2.35
Provider
vast.ai (40919270)
Hourly rate
$3.82/h
Benchmark time
42.59s
Machine-hours / 1M items
2.43 h/M
Concurrency
64

Benchmark time covers only the per-item evaluation loop on this machine, excluding model and asset loading.

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
128
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.0452. Cost estimate source: machine_time_estimate. Cost is estimated from machine time multiplied by the recorded hourly rate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 1,176,454 n/a n/a
Input cached n/a n/a n/a
Output 9,896 n/a n/a
Reasoning output n/a included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 68.14% 541 794
Candidate Count 2 92.51% 791 855
Candidate Count 3-5 85.91% 1671 1945
Candidate Count 6-10 77.98% 988 1267
POS ADJ 87.10% 574 659
POS ADV 75.38% 147 195
POS NOUN 84.88% 2459 2897
POS VERB 73.06% 811 1110
Source Dataset semeval2013 86.58% 987 1140
Source Dataset semeval2015 85.25% 630 739
Source Dataset senseval2 82.07% 1337 1629
Source Dataset senseval3 76.64% 1037 1353

Worst-Bucket Examples

figure Noun

Instance: semeval2013.d002.s002.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

Show raw prompt

user

Which numbered sense of "figure" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: According to final closing <t>figures</t>, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

Senses:
1. definition=a diagram or picture illustrating textual material | examples=the area covered can be seen from Figure 2
2. definition=alternative names for the body of a human being | examples=Leonardo studied the human body
3. definition=one of the elements that collectively form a system of numeration | examples=0 and 1 are digits
4. definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
5. definition=a well-known or notable person | examples=they studied all the great names in the history of France
6. definition=a combination of points and lines and planes that form a visible palpable shape
7. definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
8. definition=the impression produced by a person | examples=he cut a fine figure
9. definition=the property possessed by a sum or total or indefinite quantity of units or individuals | examples=he had a number of chores to do
10. definition=language used in a figurative or nonliteral sense
11. definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground
12. definition=a decorative or artistic work | examples=the coach had a design on the doors
13. definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  2. 2

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  3. 3

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  4. 4

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  5. 5

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  6. 6

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

  7. 7

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
    Selected
  8. 8

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  9. 9

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  11. 11

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

  12. 12

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  13. 13

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures

case Noun

Instance: semeval2013.d003.s011.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

U.S. firms were in some cases at a disadvantage because rivals, particularly the Chinese and other government controlled energy firms, have markedly lower labor costs and are more prone to take risks because they don't respond to shareholders.

Show raw prompt

user

Which numbered sense of "case" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: U.S. firms were in some <t>cases</t> at a disadvantage because rivals, particularly the Chinese and other government controlled energy firms, have markedly lower labor costs and are more prone to take risks because they don't respond to shareholders.

Senses:
1. definition=an occurrence of something | examples=it was a case of bad judgment
2. definition=a special set of circumstances | examples=in that event, the first possibility is excluded
3. definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | examples=the family brought suit against the landlord
4. definition=the actual state of things | examples=that was not the case
5. definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | examples=the subjects for this investigation were selected randomly
8. definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. definition=the quantity contained in a case
11. definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence
12. definition=a specific state of mind that is temporary | examples=a case of the jitters
13. definition=a person of a specified kind (usually with many eccentricities) | examples=a real character
14. definition=a specific size and style of type within a type family
15. definition=an enveloping structure or covering enclosing an animal or plant organ or part
16. definition=the housing or outer covering of something | examples=the clock has a walnut case
17. definition=the enclosing frame around a door or window opening | examples=the casings had rotted away and had to be replaced
18. definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. definition=bed linen consisting of a cover for a pillow | examples=the burglar carried his loot in a pillowcase
20. definition=a glass container used to store and display items in a shop or museum or home

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

    Selected
  3. 3

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

  4. 4

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
  5. 5

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  6. 6

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  7. 7

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  8. 8

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
  9. 9

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  10. 10

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  11. 11

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  12. 12

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
  13. 13

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  14. 14

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

  15. 15

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  16. 16

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  17. 17

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  18. 18

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  19. 19

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  20. 20

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine

charge Noun

Instance: semeval2013.d004.s004.t007 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The institutions thereby want to wiggle themselves free from the restrictions going hand-in-hand with the acceptance of the money, such as the limits on manager bonuses and the paying of high charges.

Show raw prompt

user

Which numbered sense of "charge" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The institutions thereby want to wiggle themselves free from the restrictions going hand-in-hand with the acceptance of the money, such as the limits on manager bonuses and the paying of high <t>charges</t>.

Senses:
1. definition=an impetuous rush toward someone or something | examples=the wrestler's charge carried him past his adversary
2. definition=(criminal law) a pleading describing some wrong or offense | examples=he was arrested on a charge of larceny
3. definition=the price charged for some article or service | examples=the admission charge
4. definition=the quantity of unbalanced electricity in a body (either positive or negative) and construed as an excess or deficiency of electrons | examples=the battery needed a fresh charge
5. definition=attention and management implying responsibility for safety | examples=he is in the care of a bodyguard
6. definition=a special assignment that is given to a person or group | examples=a confidential mission to London
7. definition=a person committed to your care | examples=the teacher led her charges across the street
8. definition=financial liabilities (such as a tax) | examples=the charges against the estate
9. definition=(psychoanalysis) the libidinal energy invested in some idea or person or object | examples=Freud thought of cathexis as a psychic analog of an electrical charge
10. definition=the swift release of a store of affective force | examples=they got a great bang out of it
11. definition=request for payment of a debt | examples=they submitted their charges at the end of each month
12. definition=a formal statement of a command or injunction to do something | examples=the judge's charge to the jury
13. definition=an assertion that someone is guilty of a fault or offence | examples=the newspaper published charges that Jones was guilty of drunken driving
14. definition=heraldry consisting of a design or image depicted on a shield
15. definition=a quantity of explosive to be set off at one time | examples=this cartridge has a powder charge of 50 grains

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an impetuous rush toward someone or something

    charge%1:04:01:: · charge.n.01

    • the wrestler's charge carried him past his adversary
    • the battle began with a cavalry charge
  2. 2

    (criminal law) a pleading describing some wrong or offense

    charge%1:10:00:: · charge.n.02

    • he was arrested on a charge of larceny

    Synonyms: complaint

  3. 3

    the price charged for some article or service

    charge%1:21:02:: · charge.n.03

    • the admission charge
    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    the quantity of unbalanced electricity in a body (either positive or negative) and construed as an excess or deficiency of electrons

    charge%1:19:00:: · charge.n.04

    • the battery needed a fresh charge

    Synonyms: electric charge

  5. 5

    attention and management implying responsibility for safety

    charge%1:04:00:: · care.n.05

    • he is in the care of a bodyguard

    Synonyms: care, tutelage, guardianship

  6. 6

    a special assignment that is given to a person or group

    charge%1:04:03:: · mission.n.03

    • a confidential mission to London
    • his charge was deliver a message

    Synonyms: mission, commission

  7. 7

    a person committed to your care

    charge%1:18:00:: · charge.n.07

    • the teacher led her charges across the street
  8. 8

    financial liabilities (such as a tax)

    charge%1:21:01:: · charge.n.08

    • the charges against the estate
    Selected
  9. 9

    (psychoanalysis) the libidinal energy invested in some idea or person or object

    charge%1:16:00:: · cathexis.n.01

    • Freud thought of cathexis as a psychic analog of an electrical charge

    Synonyms: cathexis

  10. 10

    the swift release of a store of affective force

    charge%1:12:00:: · bang.n.04

    • they got a great bang out of it
    • what a boot!

    Synonyms: bang, boot, rush, flush, thrill, kick

  11. 11

    request for payment of a debt

    charge%1:10:03:: · charge.n.11

    • they submitted their charges at the end of each month

    Synonyms: billing

  12. 12

    a formal statement of a command or injunction to do something

    charge%1:10:01:: · commission.n.06

    • the judge's charge to the jury

    Synonyms: commission, direction

  13. 13

    an assertion that someone is guilty of a fault or offence

    charge%1:10:04:: · accusation.n.02

    • the newspaper published charges that Jones was guilty of drunken driving

    Synonyms: accusation

  14. 14

    heraldry consisting of a design or image depicted on a shield

    charge%1:06:01:: · charge.n.14

    Synonyms: bearing, heraldic bearing, armorial bearing

  15. 15

    a quantity of explosive to be set off at one time

    charge%1:06:00:: · charge.n.15

    • this cartridge has a powder charge of 50 grains

    Synonyms: burster, bursting charge, explosive charge

court Noun

Instance: semeval2013.d005.s005.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the <t>courts</t> for years.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business
2. definition=a room in which a lawcourt sits | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947)
6. definition=the family and retinue of a sovereign or prince
7. definition=a hotel for motorists; provides direct access from rooms to parking area
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | examples=the house was built around an inner court
11. definition=respectful deference | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

rule Noun

Instance: semeval2013.d005.s007.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The claim could force appeals judges to grapple with the question of whether new technology requires new courtroom rules.

Show raw prompt

user

Which numbered sense of "rule" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The claim could force appeals judges to grapple with the question of whether new technology requires new courtroom <t>rules</t>.

Senses:
1. definition=a principle or condition that customarily governs behavior | examples=it was his rule to take a walk before breakfast
2. definition=something regarded as a normative example | examples=the convention of not naming the main character
3. definition=prescribed guide for conduct or action
4. definition=(linguistics) a rule describing (or prescribing) a linguistic practice
5. definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | examples=their principles of composition characterized all their works
6. definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
7. definition=dominance or power through legal authority | examples=France held undisputed dominion over vast areas of Africa
8. definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
9. definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
10. definition=a rule or law concerning a natural phenomenon or the function of a complex system | examples=the principle of the conservation of mass
11. definition=(mathematics) a standard procedure for solving a class of mathematical problems | examples=he determined the upper bound with Descartes' rule of signs
12. definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

  2. 2

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

  3. 3

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  5. 5

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  6. 6

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  7. 7

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

  8. 8

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
    Selected
  9. 9

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic
  10. 10

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  11. 11

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  12. 12

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler

case Noun

Instance: semeval2013.d005.s023.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

Show raw prompt

user

Which numbered sense of "case" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: They noted in a challenge to the verdict filed last month that the <t>case</t> dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

Senses:
1. definition=an occurrence of something | examples=it was a case of bad judgment
2. definition=a special set of circumstances | examples=in that event, the first possibility is excluded
3. definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | examples=the family brought suit against the landlord
4. definition=the actual state of things | examples=that was not the case
5. definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | examples=the subjects for this investigation were selected randomly
8. definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. definition=the quantity contained in a case
11. definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence
12. definition=a specific state of mind that is temporary | examples=a case of the jitters
13. definition=a person of a specified kind (usually with many eccentricities) | examples=a real character
14. definition=a specific size and style of type within a type family
15. definition=an enveloping structure or covering enclosing an animal or plant organ or part
16. definition=the housing or outer covering of something | examples=the clock has a walnut case
17. definition=the enclosing frame around a door or window opening | examples=the casings had rotted away and had to be replaced
18. definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. definition=bed linen consisting of a cover for a pillow | examples=the burglar carried his loot in a pillowcase
20. definition=a glass container used to store and display items in a shop or museum or home

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

  2. 2

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

  3. 3

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
  5. 5

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  6. 6

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  7. 7

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  8. 8

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
    Selected
  9. 9

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  10. 10

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  11. 11

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  12. 12

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
  13. 13

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  14. 14

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

  15. 15

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  16. 16

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  17. 17

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  18. 18

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  19. 19

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  20. 20

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine

case Noun

Instance: semeval2013.d005.s024.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

They argued that the news media continually fanned the flames of emotion about the case.

Show raw prompt

user

Which numbered sense of "case" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: They argued that the news media continually fanned the flames of emotion about the <t>case</t>.

Senses:
1. definition=an occurrence of something | examples=it was a case of bad judgment
2. definition=a special set of circumstances | examples=in that event, the first possibility is excluded
3. definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | examples=the family brought suit against the landlord
4. definition=the actual state of things | examples=that was not the case
5. definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | examples=the subjects for this investigation were selected randomly
8. definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. definition=the quantity contained in a case
11. definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence
12. definition=a specific state of mind that is temporary | examples=a case of the jitters
13. definition=a person of a specified kind (usually with many eccentricities) | examples=a real character
14. definition=a specific size and style of type within a type family
15. definition=an enveloping structure or covering enclosing an animal or plant organ or part
16. definition=the housing or outer covering of something | examples=the clock has a walnut case
17. definition=the enclosing frame around a door or window opening | examples=the casings had rotted away and had to be replaced
18. definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. definition=bed linen consisting of a cover for a pillow | examples=the burglar carried his loot in a pillowcase
20. definition=a glass container used to store and display items in a shop or museum or home

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

  2. 2

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

  3. 3

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
  5. 5

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  6. 6

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  7. 7

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  8. 8

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
    Selected
  9. 9

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  10. 10

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  11. 11

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  12. 12

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
  13. 13

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  14. 14

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

  15. 15

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  16. 16

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  17. 17

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  18. 18

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  19. 19

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  20. 20

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine

case Noun

Instance: semeval2013.d006.s008.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Show raw prompt

user

Which numbered sense of "case" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Part of the debate arisen in the related <t>case</t> is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Senses:
1. definition=an occurrence of something | examples=it was a case of bad judgment
2. definition=a special set of circumstances | examples=in that event, the first possibility is excluded
3. definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | examples=the family brought suit against the landlord
4. definition=the actual state of things | examples=that was not the case
5. definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | examples=the subjects for this investigation were selected randomly
8. definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. definition=the quantity contained in a case
11. definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence
12. definition=a specific state of mind that is temporary | examples=a case of the jitters
13. definition=a person of a specified kind (usually with many eccentricities) | examples=a real character
14. definition=a specific size and style of type within a type family
15. definition=an enveloping structure or covering enclosing an animal or plant organ or part
16. definition=the housing or outer covering of something | examples=the clock has a walnut case
17. definition=the enclosing frame around a door or window opening | examples=the casings had rotted away and had to be replaced
18. definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. definition=bed linen consisting of a cover for a pillow | examples=the burglar carried his loot in a pillowcase
20. definition=a glass container used to store and display items in a shop or museum or home

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

  3. 3

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

  4. 4

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
  5. 5

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  6. 6

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  7. 7

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  8. 8

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
    Selected
  9. 9

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  10. 10

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  11. 11

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  12. 12

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
  13. 13

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  14. 14

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

  15. 15

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  16. 16

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  17. 17

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  18. 18

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  19. 19

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  20. 20

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine

thing Noun

Instance: semeval2013.d006.s013.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

However, the paradoxical thing about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee.

Show raw prompt

user

Which numbered sense of "thing" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: However, the paradoxical <t>thing</t> about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee.

Senses:
1. definition=a special situation | examples=this thing has got to end
2. definition=an action | examples=how could you do such a thing?
3. definition=a special abstraction | examples=a thing of the spirit
4. definition=an artifact | examples=how does this thing work?
5. definition=an event | examples=a funny thing happened on the way to the...
6. definition=a vaguely specified concern | examples=several matters to attend to
7. definition=a statement regarded as an object | examples=to say the same thing in other terms
8. definition=an entity that is not named specifically | examples=I couldn't tell what the thing was
9. definition=any attribute or quality considered as having its own existence | examples=the thing I like about her is ...
10. definition=a special objective | examples=the thing is to stay in bounds
11. definition=a persistent illogical feeling of desire or aversion | examples=he has a thing about seafood
12. definition=a separate and self-contained entity

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a special situation

    thing%1:26:00:: · thing.n.01

    • this thing has got to end
    • it is a remarkable thing
    Selected
  2. 2

    an action

    thing%1:04:00:: · thing.n.02

    • how could you do such a thing?
  3. 3

    a special abstraction

    thing%1:09:00:: · thing.n.03

    • a thing of the spirit
    • things of the heart
  4. 4

    an artifact

    thing%1:06:00:: · thing.n.04

    • how does this thing work?
  5. 5

    an event

    thing%1:11:00:: · thing.n.05

    • a funny thing happened on the way to the...
  6. 6

    a vaguely specified concern

    thing%1:09:02:: · matter.n.01

    • several matters to attend to
    • it is none of your affair

    Synonyms: matter, affair

  7. 7

    a statement regarded as an object

    thing%1:10:00:: · thing.n.07

    • to say the same thing in other terms
    • how can you say such a thing?
  8. 8

    an entity that is not named specifically

    thing%1:06:01:: · thing.n.08

    • I couldn't tell what the thing was
  9. 9

    any attribute or quality considered as having its own existence

    thing%1:07:00:: · thing.n.09

    • the thing I like about her is ...
    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    a special objective

    thing%1:09:01:: · thing.n.10

    • the thing is to stay in bounds
  11. 11

    a persistent illogical feeling of desire or aversion

    thing%1:12:00:: · thing.n.11

    • he has a thing about seafood
    • she has a thing about him
  12. 12

    a separate and self-contained entity

    thing%1:03:00:: · thing.n.12

game Noun

Instance: semeval2013.d006.s016.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same game, because evidently the result of the action supposes leaving their own team with less players.

Show raw prompt

user

Which numbered sense of "game" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same <t>game</t>, because evidently the result of the action supposes leaving their own team with less players.

Senses:
1. definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. definition=a single play of a sport or other contest | examples=the game lasted two hours
3. definition=an amusement or pastime | examples=they played word games
4. definition=animal hunted for food or sport
5. definition=(tennis) a division of play during which one player serves
6. definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all
7. definition=the flesh of wild animals that is used for food
8. definition=a secret scheme to do something (especially something underhand or illegal) | examples=they concocted a plot to discredit the governor
9. definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. definition=your occupation or line of work | examples=he's in the plumbing game
11. definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d006.s017.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

And neither is it a useful strategy for the next game, because the club will not be able to count on those players.

Show raw prompt

user

Which numbered sense of "game" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: And neither is it a useful strategy for the next <t>game</t>, because the club will not be able to count on those players.

Senses:
1. definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. definition=a single play of a sport or other contest | examples=the game lasted two hours
3. definition=an amusement or pastime | examples=they played word games
4. definition=animal hunted for food or sport
5. definition=(tennis) a division of play during which one player serves
6. definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all
7. definition=the flesh of wild animals that is used for food
8. definition=a secret scheme to do something (especially something underhand or illegal) | examples=they concocted a plot to discredit the governor
9. definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. definition=your occupation or line of work | examples=he's in the plumbing game
11. definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

round Noun

Instance: semeval2013.d006.s020.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

So that, by passing rounds, it is not so clear that it is an advantage.

Show raw prompt

user

Which numbered sense of "round" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: So that, by passing <t>rounds</t>, it is not so clear that it is an advantage.

Senses:
1. definition=a charge of ammunition for a single shot
2. definition=an interval during which a recurring sequence of events occurs | examples=the never-ending cycle of the seasons
3. definition=a regular route for a sentry or policeman | examples=in the old days a policeman walked a beat and knew all his people by name
4. definition=(often plural) a series of professional calls (usually in a set order) | examples=the doctor goes on his rounds first thing every morning
5. definition=the activity of playing 18 holes of golf | examples=a round of golf takes about 4 hours
6. definition=the usual activities in your day | examples=the doctor made his rounds
7. definition=(sports) a division during which one team is on the offensive
8. definition=the course along which communications spread | examples=the story is going the rounds in Washington
9. definition=a serving to each of a group (usually alcoholic) | examples=he ordered a second round
10. definition=a cut of beef between the rump and the lower leg
11. definition=a partsong in which voices follow each other; one voice starts and others join in one after another until all are singing different parts of the song at the same time | examples=they enjoyed singing rounds
12. definition=an outburst of applause | examples=there was a round of applause
13. definition=a crosspiece between the legs of a chair
14. definition=any circular or rotating mechanism | examples=the machine punched out metal circles

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a charge of ammunition for a single shot

    round%1:06:01:: · round.n.01

    Synonyms: unit of ammunition, one shot

  2. 2

    an interval during which a recurring sequence of events occurs

    round%1:28:01:: · cycle.n.01

    • the never-ending cycle of the seasons

    Synonyms: cycle, rhythm

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    a regular route for a sentry or policeman

    round%1:15:00:: · beat.n.01

    • in the old days a policeman walked a beat and knew all his people by name

    Synonyms: beat

  4. 4

    (often plural) a series of professional calls (usually in a set order)

    round%1:04:00:: · round.n.04

    • the doctor goes on his rounds first thing every morning
    • the postman's rounds
    Selected
  5. 5

    the activity of playing 18 holes of golf

    round%1:04:03:: · round_of_golf.n.01

    • a round of golf takes about 4 hours

    Synonyms: round of golf

  6. 6

    the usual activities in your day

    round%1:04:01:: · round.n.06

    • the doctor made his rounds

    Synonyms: daily round

  7. 7

    (sports) a division during which one team is on the offensive

    round%1:28:00:: · turn.n.09

    Synonyms: turn, bout

  8. 8

    the course along which communications spread

    round%1:17:00:: · round.n.08

    • the story is going the rounds in Washington
  9. 9

    a serving to each of a group (usually alcoholic)

    round%1:13:01:: · round.n.09

    • he ordered a second round

    Synonyms: round of drinks

  10. 10

    a cut of beef between the rump and the lower leg

    round%1:13:00:: · round.n.10

  11. 11

    a partsong in which voices follow each other; one voice starts and others join in one after another until all are singing different parts of the song at the same time

    round%1:10:00:: · round.n.11

    • they enjoyed singing rounds

    Synonyms: troll

  12. 12

    an outburst of applause

    round%1:10:01:: · round.n.12

    • there was a round of applause
  13. 13

    a crosspiece between the legs of a chair

    round%1:06:03:: · rung.n.01

    Synonyms: rung, stave

  14. 14

    any circular or rotating mechanism

    round%1:06:00:: · circle.n.08

    • the machine punched out metal circles

    Synonyms: circle