Verified run

gpt-6-luna

gpt-6-luna-low-reasoning-p002-lexen-v1-20261009

Rank
119
Accuracy lexEN v1 · WordNet fine
90.93%
Correct
4420 / 4861
Actual run cost
$0.221
Cost / M items
$45.46

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 90.93% 4420 / 4861 96.89% 4710 / 4861 93.91% 4565 / 4861
Maru 2022 (ALLamended) 88.25% 4290 / 4861 95.93% 4663 / 4861 92.12% 4478 / 4861
Raganato 2017 (original) 82.37% 4004 / 4861 93.46% 4543 / 4861 88.29% 4292 / 4861

Model

Display
gpt-6-luna
Requested
gpt-6-luna
Resolved
gpt-6-luna
Vendor
OpenAI
API provider
OpenAI
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
low
Model URL
n/a
Endpoint
n/a
Resolved counts
gpt-6-luna: 4861

Reproducibility

Created
2026-10-09T13:26:29.232898+00:00
Run schema
sensebench-run-v2
Commit
9040664a78ce4afacbe5400eaf6538ee664f3dea
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p002
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
1,509,286
Tokens / item
310.5
Total cost
$0.221
Cost / M items
$45.46
Cost source
litellm_estimate
Elapsed
1.95m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
32,768
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.221. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 1,117,887 $0.112 $0.100
Input cached 0 $0.00 $0.0100
Output 218,360 $0.109 $0.500
Reasoning output 173,039 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 88.41% 702 794
Candidate Count 2 95.91% 820 855
Candidate Count 3-5 90.33% 1757 1945
Candidate Count 6-10 90.06% 1141 1267
POS ADJ 89.83% 592 659
POS ADV 90.26% 176 195
POS NOUN 91.89% 2662 2897
POS VERB 89.19% 990 1110
Source Dataset semeval2013 93.42% 1065 1140
Source Dataset semeval2015 89.45% 661 739
Source Dataset senseval2 91.28% 1487 1629
Source Dataset senseval3 89.21% 1207 1353

Worst-Bucket Examples

support Noun

Instance: semeval2013.d004.s000.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

US banks repay state support

Show raw prompt

user

Which numbered sense of "support" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: US banks repay state <t>support</t>

Senses:
1. definition=the activity of providing for or maintaining by supplying with money or necessities | examples=his support kept the family together
2. definition=aiding the cause or policy or interests of | examples=the president no longer has the support of his own party
3. definition=something providing immaterial assistance to a person or cause or interest | examples=the policy found little public support
4. definition=a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission | examples=they called for artillery support
5. definition=documentary validation | examples=his documentation of the results was excellent
6. definition=the financial means whereby one lives | examples=each child was expected to pay for their keep
7. definition=supporting structure that holds up or provides a foundation | examples=the statue stood on a marble support
8. definition=the act of bearing the weight of or strengthening | examples=he leaned against the wall for support
9. definition=a musical part (vocal or instrumental) that supports or provides background for other musical parts
10. definition=any device that bears the weight of another thing | examples=there was no place to attach supports for a shelf
11. definition=financial resources provided to make some project possible | examples=the foundation provided support for the experiment

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the activity of providing for or maintaining by supplying with money or necessities

    support%1:04:04:: · support.n.01

    • his support kept the family together
    • they gave him emotional support during difficult times
    Selected
  2. 2

    aiding the cause or policy or interests of

    support%1:04:00:: · support.n.02

    • the president no longer has the support of his own party
    • they developed a scheme of mutual support
  3. 3

    something providing immaterial assistance to a person or cause or interest

    support%1:09:00:: · support.n.03

    • the policy found little public support
    • his faith was all the support he needed
  4. 4

    a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission

    support%1:04:03:: · support.n.04

    • they called for artillery support

    Synonyms: reinforcement, reenforcement

  5. 5

    documentary validation

    support%1:04:02:: · documentation.n.03

    • his documentation of the results was excellent
    • the strongest support for this view is the work of Jones

    Synonyms: documentation

  6. 6

    the financial means whereby one lives

    support%1:21:00:: · support.n.06

    • each child was expected to pay for their keep
    • he applied to the state for support

    Synonyms: keep, livelihood, living, bread and butter, sustenance

  7. 7

    supporting structure that holds up or provides a foundation

    support%1:06:01:: · support.n.07

    • the statue stood on a marble support
  8. 8

    the act of bearing the weight of or strengthening

    support%1:04:01:: · support.n.08

    • he leaned against the wall for support

    Synonyms: supporting

  9. 9

    a musical part (vocal or instrumental) that supports or provides background for other musical parts

    support%1:10:01:: · accompaniment.n.02

    Synonyms: accompaniment, musical accompaniment, backup

  10. 10

    any device that bears the weight of another thing

    support%1:06:00:: · support.n.10

    • there was no place to attach supports for a shelf
  11. 11

    financial resources provided to make some project possible

    support%1:21:01:: · support.n.11

    • the foundation provided support for the experiment

    Synonyms: financial support, funding, backing, financial backing

    Gold lexEN Gold Maru 2022 Gold Raganato

support Noun

Instance: semeval2013.d004.s002.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

On Wednesday Bank of America repaid the support from the bank protection fund TARP in the amount USD 45 billion (nearly EUR 30 billion) in one go.

Show raw prompt

user

Which numbered sense of "support" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: On Wednesday Bank of America repaid the <t>support</t> from the bank protection fund TARP in the amount USD 45 billion (nearly EUR 30 billion) in one go.

Senses:
1. definition=the activity of providing for or maintaining by supplying with money or necessities | examples=his support kept the family together
2. definition=aiding the cause or policy or interests of | examples=the president no longer has the support of his own party
3. definition=something providing immaterial assistance to a person or cause or interest | examples=the policy found little public support
4. definition=a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission | examples=they called for artillery support
5. definition=documentary validation | examples=his documentation of the results was excellent
6. definition=the financial means whereby one lives | examples=each child was expected to pay for their keep
7. definition=supporting structure that holds up or provides a foundation | examples=the statue stood on a marble support
8. definition=the act of bearing the weight of or strengthening | examples=he leaned against the wall for support
9. definition=a musical part (vocal or instrumental) that supports or provides background for other musical parts
10. definition=any device that bears the weight of another thing | examples=there was no place to attach supports for a shelf
11. definition=financial resources provided to make some project possible | examples=the foundation provided support for the experiment

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the activity of providing for or maintaining by supplying with money or necessities

    support%1:04:04:: · support.n.01

    • his support kept the family together
    • they gave him emotional support during difficult times
    Selected
  2. 2

    aiding the cause or policy or interests of

    support%1:04:00:: · support.n.02

    • the president no longer has the support of his own party
    • they developed a scheme of mutual support
  3. 3

    something providing immaterial assistance to a person or cause or interest

    support%1:09:00:: · support.n.03

    • the policy found little public support
    • his faith was all the support he needed
  4. 4

    a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission

    support%1:04:03:: · support.n.04

    • they called for artillery support

    Synonyms: reinforcement, reenforcement

  5. 5

    documentary validation

    support%1:04:02:: · documentation.n.03

    • his documentation of the results was excellent
    • the strongest support for this view is the work of Jones

    Synonyms: documentation

  6. 6

    the financial means whereby one lives

    support%1:21:00:: · support.n.06

    • each child was expected to pay for their keep
    • he applied to the state for support

    Synonyms: keep, livelihood, living, bread and butter, sustenance

  7. 7

    supporting structure that holds up or provides a foundation

    support%1:06:01:: · support.n.07

    • the statue stood on a marble support
  8. 8

    the act of bearing the weight of or strengthening

    support%1:04:01:: · support.n.08

    • he leaned against the wall for support

    Synonyms: supporting

  9. 9

    a musical part (vocal or instrumental) that supports or provides background for other musical parts

    support%1:10:01:: · accompaniment.n.02

    Synonyms: accompaniment, musical accompaniment, backup

  10. 10

    any device that bears the weight of another thing

    support%1:06:00:: · support.n.10

    • there was no place to attach supports for a shelf
  11. 11

    financial resources provided to make some project possible

    support%1:21:01:: · support.n.11

    • the foundation provided support for the experiment

    Synonyms: financial support, funding, backing, financial backing

    Gold lexEN Gold Maru 2022 Gold Raganato

court Noun

Instance: semeval2013.d005.s005.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the <t>courts</t> for years.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business
2. definition=a room in which a lawcourt sits | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947)
6. definition=the family and retinue of a sovereign or prince
7. definition=a hotel for motorists; provides direct access from rooms to parking area
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | examples=the house was built around an inner court
11. definition=respectful deference | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

case Noun

Instance: semeval2013.d005.s024.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

They argued that the news media continually fanned the flames of emotion about the case.

Show raw prompt

user

Which numbered sense of "case" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: They argued that the news media continually fanned the flames of emotion about the <t>case</t>.

Senses:
1. definition=an occurrence of something | examples=it was a case of bad judgment
2. definition=a special set of circumstances | examples=in that event, the first possibility is excluded
3. definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | examples=the family brought suit against the landlord
4. definition=the actual state of things | examples=that was not the case
5. definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | examples=the subjects for this investigation were selected randomly
8. definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. definition=the quantity contained in a case
11. definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence
12. definition=a specific state of mind that is temporary | examples=a case of the jitters
13. definition=a person of a specified kind (usually with many eccentricities) | examples=a real character
14. definition=a specific size and style of type within a type family
15. definition=an enveloping structure or covering enclosing an animal or plant organ or part
16. definition=the housing or outer covering of something | examples=the clock has a walnut case
17. definition=the enclosing frame around a door or window opening | examples=the casings had rotted away and had to be replaced
18. definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. definition=bed linen consisting of a cover for a pillow | examples=the burglar carried his loot in a pillowcase
20. definition=a glass container used to store and display items in a shop or museum or home

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

  2. 2

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

  3. 3

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
  5. 5

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  6. 6

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  7. 7

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  8. 8

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
    Selected
  9. 9

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  10. 10

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  11. 11

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  12. 12

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
  13. 13

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  14. 14

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

  15. 15

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  16. 16

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  17. 17

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  18. 18

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  19. 19

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  20. 20

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine

court Noun

Instance: semeval2013.d005.s028.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the <t>courts</t>.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business
2. definition=a room in which a lawcourt sits | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947)
6. definition=the family and retinue of a sovereign or prince
7. definition=a hotel for motorists; provides direct access from rooms to parking area
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | examples=the house was built around an inner court
11. definition=respectful deference | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

rule Noun

Instance: semeval2013.d006.s007.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

It is so extended that it part of the ethos, of the unwritten rules, but followed nonetheless by this sport.

Show raw prompt

user

Which numbered sense of "rule" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: It is so extended that it part of the ethos, of the unwritten <t>rules</t>, but followed nonetheless by this sport.

Senses:
1. definition=a principle or condition that customarily governs behavior | examples=it was his rule to take a walk before breakfast
2. definition=something regarded as a normative example | examples=the convention of not naming the main character
3. definition=prescribed guide for conduct or action
4. definition=(linguistics) a rule describing (or prescribing) a linguistic practice
5. definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | examples=their principles of composition characterized all their works
6. definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
7. definition=dominance or power through legal authority | examples=France held undisputed dominion over vast areas of Africa
8. definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
9. definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
10. definition=a rule or law concerning a natural phenomenon or the function of a complex system | examples=the principle of the conservation of mass
11. definition=(mathematics) a standard procedure for solving a class of mathematical problems | examples=he determined the upper bound with Descartes' rule of signs
12. definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

    Gold Raganato Selected
  2. 2

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

  3. 3

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

  4. 4

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  5. 5

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  6. 6

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  7. 7

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

  8. 8

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
    Gold lexEN Gold Maru 2022
  9. 9

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic
  10. 10

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  11. 11

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  12. 12

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler

part Noun

Instance: semeval2013.d006.s008.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Show raw prompt

user

Which numbered sense of "part" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: <t>Part</t> of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Senses:
1. definition=something determined in relation to something that includes it | examples=he wanted to feel a part of something bigger than himself
2. definition=something less than the whole of a human artifact | examples=the rear part of the house
3. definition=a portion of a natural object | examples=they analyzed the river into three parts
4. definition=that which concerns a person with regard to a particular role or situation | examples=it requires vigilance on our part
5. definition=the extended spatial location of something | examples=the farming regions of France
6. definition=the actions and activities assigned to or required or expected of a person or group | examples=the function of a teacher
7. definition=an actor's portrayal of someone in a play | examples=she played the part of Desdemona
8. definition=assets belonging to or due to or contributed by an individual person or group | examples=he wanted his share in cash
9. definition=one of the portions into which something is regarded as divided and which together constitute a whole | examples=the written part of the exam
10. definition=a line of scalp that can be seen when sections of hair are combed in opposite directions | examples=his part was right in the middle
11. definition=the melody carried by a particular voice or instrument in polyphonic music | examples=he tried to sing the tenor part
12. definition=the part played by a person in bringing about a result | examples=I am proud of my contribution in advancing the project

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    something determined in relation to something that includes it

    part%1:24:00:: · part.n.01

    • he wanted to feel a part of something bigger than himself
    • I read a portion of the manuscript

    Synonyms: portion, component part, component, constituent

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    something less than the whole of a human artifact

    part%1:06:00:: · part.n.02

    • the rear part of the house
    • glue the two parts together

    Synonyms: portion

  3. 3

    a portion of a natural object

    part%1:17:00:: · part.n.03

    • they analyzed the river into three parts
    • he needed a piece of granite

    Synonyms: piece

  4. 4

    that which concerns a person with regard to a particular role or situation

    part%1:09:02:: · part.n.04

    • it requires vigilance on our part
    • they resisted every effort on his part
  5. 5

    the extended spatial location of something

    part%1:15:00:: · region.n.01

    • the farming regions of France
    • religions in all parts of the world

    Synonyms: region

  6. 6

    the actions and activities assigned to or required or expected of a person or group

    part%1:04:01:: · function.n.03

    • the function of a teacher
    • the government must do its part

    Synonyms: function, office, role

  7. 7

    an actor's portrayal of someone in a play

    part%1:09:01:: · character.n.04

    • she played the part of Desdemona

    Synonyms: character, role, theatrical role, persona

  8. 8

    assets belonging to or due to or contributed by an individual person or group

    part%1:21:00:: · share.n.01

    • he wanted his share in cash

    Synonyms: share, portion, percentage

  9. 9

    one of the portions into which something is regarded as divided and which together constitute a whole

    part%1:09:00:: · part.n.09

    • the written part of the exam
    • the finance section of the company

    Synonyms: section, division

    Selected
  10. 10

    a line of scalp that can be seen when sections of hair are combed in opposite directions

    part%1:08:01:: · part.n.10

    • his part was right in the middle

    Synonyms: parting

  11. 11

    the melody carried by a particular voice or instrument in polyphonic music

    part%1:10:00:: · part.n.11

    • he tried to sing the tenor part

    Synonyms: voice

  12. 12

    the part played by a person in bringing about a result

    part%1:04:03:: · contribution.n.01

    • I am proud of my contribution in advancing the project
    • they all did their share of the work

    Synonyms: contribution, share

life Noun

Instance: semeval2013.d007.s005.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

"That makes it very peculiar, though it falls short of being some form of truly 'alien' life," commented Paul C. W. Davies of Arizona State University, a co-author of the report appearing in Thursday's online edition of the journal Science.

Show raw prompt

user

Which numbered sense of "life" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: "That makes it very peculiar, though it falls short of being some form of truly 'alien' <t>life</t>," commented Paul C. W. Davies of Arizona State University, a co-author of the report appearing in Thursday's online edition of the journal Science.

Senses:
1. definition=a characteristic state or mode of living | examples=social life
2. definition=the experience of being alive; the course of human events and activities | examples=he could no longer cope with the complexities of life
3. definition=the course of existence of an individual; the actions and events that occur in living | examples=he hoped for a new life in Australia
4. definition=the condition of living or the state of being alive | examples=while there's life there's hope
5. definition=the period during which something is functional (as between birth and death) | examples=the battery had a short life
6. definition=the period between birth and the present time | examples=I have known him all his life
7. definition=the period from the present until death | examples=he appointed himself emperor for life
8. definition=a living person | examples=his heroism saved a life
9. definition=animation and energy in action or expression | examples=it was a heavy play and the actors tried in vain to give life to it
10. definition=living things collectively | examples=the oceans are teeming with life
11. definition=the organic phenomenon that distinguishes living organisms from nonliving ones | examples=there is no life on the moon
12. definition=an account of the series of events making up a person's life
13. definition=a motive for living | examples=pottery was his life
14. definition=a prison term lasting as long as the prisoner lives | examples=he got life for killing the guard

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a characteristic state or mode of living

    life%1:26:01:: · life.n.01

    • social life
    • city life
  2. 2

    the experience of being alive; the course of human events and activities

    life%1:09:00:: · life.n.02

    • he could no longer cope with the complexities of life

    Synonyms: living

  3. 3

    the course of existence of an individual; the actions and events that occur in living

    life%1:26:02:: · life.n.03

    • he hoped for a new life in Australia
    • he wanted to live his own life without interference from others
  4. 4

    the condition of living or the state of being alive

    life%1:26:00:: · animation.n.01

    • while there's life there's hope
    • life depends on many chemical and physical processes

    Synonyms: animation, living, aliveness

  5. 5

    the period during which something is functional (as between birth and death)

    life%1:28:00:: · life.n.05

    • the battery had a short life
    • he lived a long and happy life

    Synonyms: lifetime, lifespan

  6. 6

    the period between birth and the present time

    life%1:28:01:: · life.n.06

    • I have known him all his life
  7. 7

    the period from the present until death

    life%1:28:02:: · life.n.07

    • he appointed himself emperor for life
  8. 8

    a living person

    life%1:18:00:: · life.n.08

    • his heroism saved a life
  9. 9

    animation and energy in action or expression

    life%1:07:01:: · liveliness.n.02

    • it was a heavy play and the actors tried in vain to give life to it

    Synonyms: liveliness, spirit, sprightliness

  10. 10

    living things collectively

    life%1:03:00:: · life.n.10

    • the oceans are teeming with life
    Selected
  11. 11

    the organic phenomenon that distinguishes living organisms from nonliving ones

    life%1:19:00:: · life.n.11

    • there is no life on the moon
    Gold lexEN Gold Maru 2022 Gold Raganato
  12. 12

    an account of the series of events making up a person's life

    life%1:10:00:: · biography.n.01

    Synonyms: biography, life story, life history

  13. 13

    a motive for living

    life%1:16:00:: · life.n.13

    • pottery was his life
  14. 14

    a prison term lasting as long as the prisoner lives

    life%1:28:03:: · life_sentence.n.01

    • he got life for killing the guard

    Synonyms: life sentence

life Noun

Instance: semeval2013.d007.s009.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The find is important in the search for life beyond Earth because researchers need to be able to recognize life, to know what life looks like, Anbar said.

Show raw prompt

user

Which numbered sense of "life" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The find is important in the search for life beyond Earth because researchers need to be able to recognize <t>life</t>, to know what life looks like, Anbar said.

Senses:
1. definition=a characteristic state or mode of living | examples=social life
2. definition=the experience of being alive; the course of human events and activities | examples=he could no longer cope with the complexities of life
3. definition=the course of existence of an individual; the actions and events that occur in living | examples=he hoped for a new life in Australia
4. definition=the condition of living or the state of being alive | examples=while there's life there's hope
5. definition=the period during which something is functional (as between birth and death) | examples=the battery had a short life
6. definition=the period between birth and the present time | examples=I have known him all his life
7. definition=the period from the present until death | examples=he appointed himself emperor for life
8. definition=a living person | examples=his heroism saved a life
9. definition=animation and energy in action or expression | examples=it was a heavy play and the actors tried in vain to give life to it
10. definition=living things collectively | examples=the oceans are teeming with life
11. definition=the organic phenomenon that distinguishes living organisms from nonliving ones | examples=there is no life on the moon
12. definition=an account of the series of events making up a person's life
13. definition=a motive for living | examples=pottery was his life
14. definition=a prison term lasting as long as the prisoner lives | examples=he got life for killing the guard

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a characteristic state or mode of living

    life%1:26:01:: · life.n.01

    • social life
    • city life
  2. 2

    the experience of being alive; the course of human events and activities

    life%1:09:00:: · life.n.02

    • he could no longer cope with the complexities of life

    Synonyms: living

  3. 3

    the course of existence of an individual; the actions and events that occur in living

    life%1:26:02:: · life.n.03

    • he hoped for a new life in Australia
    • he wanted to live his own life without interference from others
  4. 4

    the condition of living or the state of being alive

    life%1:26:00:: · animation.n.01

    • while there's life there's hope
    • life depends on many chemical and physical processes

    Synonyms: animation, living, aliveness

  5. 5

    the period during which something is functional (as between birth and death)

    life%1:28:00:: · life.n.05

    • the battery had a short life
    • he lived a long and happy life

    Synonyms: lifetime, lifespan

  6. 6

    the period between birth and the present time

    life%1:28:01:: · life.n.06

    • I have known him all his life
  7. 7

    the period from the present until death

    life%1:28:02:: · life.n.07

    • he appointed himself emperor for life
  8. 8

    a living person

    life%1:18:00:: · life.n.08

    • his heroism saved a life
  9. 9

    animation and energy in action or expression

    life%1:07:01:: · liveliness.n.02

    • it was a heavy play and the actors tried in vain to give life to it

    Synonyms: liveliness, spirit, sprightliness

  10. 10

    living things collectively

    life%1:03:00:: · life.n.10

    • the oceans are teeming with life
    Selected
  11. 11

    the organic phenomenon that distinguishes living organisms from nonliving ones

    life%1:19:00:: · life.n.11

    • there is no life on the moon
    Gold lexEN Gold Maru 2022 Gold Raganato
  12. 12

    an account of the series of events making up a person's life

    life%1:10:00:: · biography.n.01

    Synonyms: biography, life story, life history

  13. 13

    a motive for living

    life%1:16:00:: · life.n.13

    • pottery was his life
  14. 14

    a prison term lasting as long as the prisoner lives

    life%1:28:03:: · life_sentence.n.01

    • he got life for killing the guard

    Synonyms: life sentence

court Noun

Instance: semeval2013.d009.s004.t009 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The justices agreed to hear the suit; indeed, a landmark 5.5 - hour argument is expected in March, and the outcome is likely to further roil the 2012 presidential race, which will be in full swing by the time the court's decision is released.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The justices agreed to hear the suit; indeed, a landmark 5.5 - hour argument is expected in March, and the outcome is likely to further roil the 2012 presidential race, which will be in full swing by the time the <t>court</t>'s decision is released.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business
2. definition=a room in which a lawcourt sits | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947)
6. definition=the family and retinue of a sovereign or prince
7. definition=a hotel for motorists; provides direct access from rooms to parking area
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | examples=the house was built around an inner court
11. definition=respectful deference | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

court Noun

Instance: semeval2013.d009.s018.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

"The justices were wining and dining at a black-tie fundraiser with attorneys who have pending cases before the court."

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: "The justices were wining and dining at a black-tie fundraiser with attorneys who have pending cases before the <t>court</t>."

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business
2. definition=a room in which a lawcourt sits | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947)
6. definition=the family and retinue of a sovereign or prince
7. definition=a hotel for motorists; provides direct access from rooms to parking area
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | examples=the house was built around an inner court
11. definition=respectful deference | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

game Noun

Instance: semeval2013.d010.s005.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

That number was reached Friday before the game against Panama (0-2), in Rommel Fernandez.

Show raw prompt

user

Which numbered sense of "game" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: That number was reached Friday before the <t>game</t> against Panama (0-2), in Rommel Fernandez.

Senses:
1. definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. definition=a single play of a sport or other contest | examples=the game lasted two hours
3. definition=an amusement or pastime | examples=they played word games
4. definition=animal hunted for food or sport
5. definition=(tennis) a division of play during which one player serves
6. definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all
7. definition=the flesh of wild animals that is used for food
8. definition=a secret scheme to do something (especially something underhand or illegal) | examples=they concocted a plot to discredit the governor
9. definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. definition=your occupation or line of work | examples=he's in the plumbing game
11. definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games