Verified run

gpt-6-luna

gpt-6-luna-low-reasoning-p004-lexen-v1-20261009

Rank
114
Accuracy lexEN v1 · WordNet fine
91.09%
Correct
4428 / 4861
Actual run cost
$0.401
Cost / M items
$82.57

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 91.09% 4428 / 4861 97.00% 4715 / 4861 94.51% 4594 / 4861
Maru 2022 (ALLamended) 88.11% 4283 / 4861 95.95% 4664 / 4861 92.59% 4501 / 4861
Raganato 2017 (original) 82.58% 4014 / 4861 93.44% 4542 / 4861 88.87% 4320 / 4861

Model

Display
gpt-6-luna
Requested
gpt-6-luna
Resolved
gpt-6-luna
Vendor
OpenAI
API provider
OpenAI
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
low
Model URL
n/a
Endpoint
n/a
Resolved counts
gpt-6-luna: 4861

Reproducibility

Created
2026-10-09T13:26:30.909293+00:00
Run schema
sensebench-run-v2
Commit
9040664a78ce4afacbe5400eaf6538ee664f3dea
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p004
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
3,324,606
Tokens / item
683.9
Total cost
$0.401
Cost / M items
$82.57
Cost source
litellm_estimate
Elapsed
1.97m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
32,768
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.401. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 2,971,464 $0.297 $0.100
Input cached 0 $0.00 $0.0100
Output 208,474 $0.104 $0.500
Reasoning output 144,668 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 86.52% 687 794
Candidate Count 2 96.61% 826 855
Candidate Count 3-5 91.52% 1780 1945
Candidate Count 6-10 89.58% 1135 1267
POS ADJ 92.11% 607 659
POS ADV 89.23% 174 195
POS NOUN 91.89% 2662 2897
POS VERB 88.74% 985 1110
Source Dataset semeval2013 92.98% 1060 1140
Source Dataset semeval2015 89.58% 662 739
Source Dataset senseval2 91.77% 1495 1629
Source Dataset senseval3 89.50% 1211 1353

Worst-Bucket Examples

game Noun

Instance: semeval2013.d001.s015.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77).

In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes. However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77). In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the <t>game</t> was already won and victory escaped Tel Aviv for the first time in the season.

Candidate senses:
1. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
2. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
3. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
4. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
5. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
8. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
9. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games
10. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
11. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  3. 3

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  4. 4

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  5. 5

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  8. 8

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  9. 9

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games
  10. 10

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  11. 11

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday

support Noun

Instance: semeval2013.d004.s000.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

US banks repay state support

The crisis-hit US major banks are breaking free from their state shackles.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: support
Target surface form: support
Context:
US banks repay state <t>support</t> The crisis-hit US major banks are breaking free from their state shackles.

Candidate senses:
1. sense_key=support%1:04:01:: | definition=the act of bearing the weight of or strengthening | synonyms=supporting | examples=he leaned against the wall for support
2. sense_key=support%1:10:01:: | definition=a musical part (vocal or instrumental) that supports or provides background for other musical parts | synonyms=accompaniment, musical accompaniment, backup
3. sense_key=support%1:09:00:: | definition=something providing immaterial assistance to a person or cause or interest | examples=the policy found little public support; his faith was all the support he needed
4. sense_key=support%1:21:01:: | definition=financial resources provided to make some project possible | synonyms=financial support, funding, backing, financial backing | examples=the foundation provided support for the experiment
5. sense_key=support%1:21:00:: | definition=the financial means whereby one lives | synonyms=keep, livelihood, living, bread and butter, sustenance | examples=each child was expected to pay for their keep; he applied to the state for support
6. sense_key=support%1:06:01:: | definition=supporting structure that holds up or provides a foundation | examples=the statue stood on a marble support
7. sense_key=support%1:04:02:: | definition=documentary validation | synonyms=documentation | examples=his documentation of the results was excellent; the strongest support for this view is the work of Jones
8. sense_key=support%1:04:03:: | definition=a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission | synonyms=reinforcement, reenforcement | examples=they called for artillery support
9. sense_key=support%1:06:00:: | definition=any device that bears the weight of another thing | examples=there was no place to attach supports for a shelf
10. sense_key=support%1:04:00:: | definition=aiding the cause or policy or interests of | examples=the president no longer has the support of his own party; they developed a scheme of mutual support
11. sense_key=support%1:04:04:: | definition=the activity of providing for or maintaining by supplying with money or necessities | examples=his support kept the family together; they gave him emotional support during difficult times

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the act of bearing the weight of or strengthening

    support%1:04:01:: · support.n.08

    • he leaned against the wall for support

    Synonyms: supporting

  2. 2

    a musical part (vocal or instrumental) that supports or provides background for other musical parts

    support%1:10:01:: · accompaniment.n.02

    Synonyms: accompaniment, musical accompaniment, backup

  3. 3

    something providing immaterial assistance to a person or cause or interest

    support%1:09:00:: · support.n.03

    • the policy found little public support
    • his faith was all the support he needed
  4. 4

    financial resources provided to make some project possible

    support%1:21:01:: · support.n.11

    • the foundation provided support for the experiment

    Synonyms: financial support, funding, backing, financial backing

    Gold lexEN Gold Maru 2022 Gold Raganato
  5. 5

    the financial means whereby one lives

    support%1:21:00:: · support.n.06

    • each child was expected to pay for their keep
    • he applied to the state for support

    Synonyms: keep, livelihood, living, bread and butter, sustenance

  6. 6

    supporting structure that holds up or provides a foundation

    support%1:06:01:: · support.n.07

    • the statue stood on a marble support
  7. 7

    documentary validation

    support%1:04:02:: · documentation.n.03

    • his documentation of the results was excellent
    • the strongest support for this view is the work of Jones

    Synonyms: documentation

  8. 8

    a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission

    support%1:04:03:: · support.n.04

    • they called for artillery support

    Synonyms: reinforcement, reenforcement

  9. 9

    any device that bears the weight of another thing

    support%1:06:00:: · support.n.10

    • there was no place to attach supports for a shelf
  10. 10

    aiding the cause or policy or interests of

    support%1:04:00:: · support.n.02

    • the president no longer has the support of his own party
    • they developed a scheme of mutual support
  11. 11

    the activity of providing for or maintaining by supplying with money or necessities

    support%1:04:04:: · support.n.01

    • his support kept the family together
    • they gave him emotional support during difficult times
    Selected

court Noun

Instance: semeval2013.d005.s027.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But their arguments about the effect of the intense coverage of the trial may draw the most interest.

They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

They argued that the news media continually fanned the flames of emotion about the case.

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: court
Context:
But their arguments about the effect of the intense coverage of the trial may draw the most interest. They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate. They argued that the news media continually fanned the flames of emotion about the case. "The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor <t>court</t> policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Candidate senses:
1. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
2. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
3. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
4. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
5. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor
6. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
7. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
8. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
10. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
11. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  2. 2

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  3. 3

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  5. 5

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

  6. 6

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  7. 7

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  10. 10

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  11. 11

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court

court Noun

Instance: semeval2013.d005.s028.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

They argued that the news media continually fanned the flames of emotion about the case.

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Mr. Hayes's lawyers are pressing that claim.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: courts
Context:
They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate. They argued that the news media continually fanned the flames of emotion about the case. "The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the <t>courts</t>. Mr. Hayes's lawyers are pressing that claim.

Candidate senses:
1. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
2. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
3. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
4. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
5. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
6. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor
7. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
8. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
9. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
10. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
11. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  2. 2

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  4. 4

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  5. 5

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  6. 6

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

  7. 7

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  8. 8

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  9. 9

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  10. 10

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  11. 11

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance

rule Noun

Instance: semeval2013.d006.s007.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA.

As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase.

Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players.

The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football.

It is so extended that it part of the ethos, of the unwritten rules, but followed nonetheless by this sport.

Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: rule
Target surface form: rules
Context:
The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA. As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them. This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase. Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players. The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football. It is so extended that it part of the ethos, of the unwritten <t>rules</t>, but followed nonetheless by this sport. Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Candidate senses:
1. sense_key=rule%1:09:04:: | definition=(mathematics) a standard procedure for solving a class of mathematical problems | synonyms=formula | examples=he determined the upper bound with Descartes' rule of signs; he gave us a general formula for attacking polynomials
2. sense_key=rule%1:26:00:: | definition=dominance or power through legal authority | synonyms=dominion | examples=France held undisputed dominion over vast areas of Africa; the rule of Caesar
3. sense_key=rule%1:09:03:: | definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | synonyms=principle | examples=their principles of composition characterized all their works
4. sense_key=rule%1:28:00:: | definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
5. sense_key=rule%1:10:02:: | definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
6. sense_key=rule%1:06:00:: | definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths | synonyms=ruler
7. sense_key=rule%1:10:00:: | definition=prescribed guide for conduct or action | synonyms=prescript
8. sense_key=rule%1:10:01:: | definition=(linguistics) a rule describing (or prescribing) a linguistic practice | synonyms=linguistic rule
9. sense_key=rule%1:09:00:: | definition=a principle or condition that customarily governs behavior | synonyms=regulation | examples=it was his rule to take a walk before breakfast; short haircuts were the regulation
10. sense_key=rule%1:09:01:: | definition=something regarded as a normative example | synonyms=convention, normal, pattern, formula | examples=the convention of not naming the main character; violence is the rule not the exception
11. sense_key=rule%1:09:02:: | definition=a rule or law concerning a natural phenomenon or the function of a complex system | synonyms=principle | examples=the principle of the conservation of mass; the principle of jet propulsion
12. sense_key=rule%1:10:03:: | definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  2. 2

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

  3. 3

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  4. 4

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  5. 5

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
    Gold lexEN Gold Maru 2022
  6. 6

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler

  7. 7

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

  8. 8

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  9. 9

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

    Gold Raganato Selected
  10. 10

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

  11. 11

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  12. 12

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic

game Noun

Instance: semeval2013.d006.s016.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

One of the advantages that include the sport spirit is the physical integrity of the opposite players, aspect that with these actions wasn't put into danger, that is to say, there was no violent game.

Another of these advantages to which it is alluded to with the fare-play is to avoid that the team of the lawbreaker players takes advantage unjustly of the opposite team, which did not happen either.

However, the paradoxical thing about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee.

They waited for and accepted the sanction with no complaints.

Another question is what type of advantage the violators obtained in the actions deliberately carried out.

Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same game, because evidently the result of the action supposes leaving their own team with less players.

And neither is it a useful strategy for the next game, because the club will not be able to count on those players.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
One of the advantages that include the sport spirit is the physical integrity of the opposite players, aspect that with these actions wasn't put into danger, that is to say, there was no violent game. Another of these advantages to which it is alluded to with the fare-play is to avoid that the team of the lawbreaker players takes advantage unjustly of the opposite team, which did not happen either. However, the paradoxical thing about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee. They waited for and accepted the sanction with no complaints. Another question is what type of advantage the violators obtained in the actions deliberately carried out. Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same <t>game</t>, because evidently the result of the action supposes leaving their own team with less players. And neither is it a useful strategy for the next game, because the club will not be able to count on those players.

Candidate senses:
1. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
2. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
3. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
4. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
5. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
6. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games
7. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
10. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
11. sense_key=game%1:05:00:: | definition=animal hunted for food or sport

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  2. 2

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  3. 3

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  4. 4

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  5. 5

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  6. 6

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games
  7. 7

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  10. 10

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  11. 11

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

game Noun

Instance: semeval2013.d006.s017.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Another of these advantages to which it is alluded to with the fare-play is to avoid that the team of the lawbreaker players takes advantage unjustly of the opposite team, which did not happen either.

However, the paradoxical thing about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee.

They waited for and accepted the sanction with no complaints.

Another question is what type of advantage the violators obtained in the actions deliberately carried out.

Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same game, because evidently the result of the action supposes leaving their own team with less players.

And neither is it a useful strategy for the next game, because the club will not be able to count on those players.

The advantage, obviously, consists in the fact that the players will begin the following phase of the Championship without cards that could threaten their participation in a future game.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Another of these advantages to which it is alluded to with the fare-play is to avoid that the team of the lawbreaker players takes advantage unjustly of the opposite team, which did not happen either. However, the paradoxical thing about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee. They waited for and accepted the sanction with no complaints. Another question is what type of advantage the violators obtained in the actions deliberately carried out. Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same game, because evidently the result of the action supposes leaving their own team with less players. And neither is it a useful strategy for the next <t>game</t>, because the club will not be able to count on those players. The advantage, obviously, consists in the fact that the players will begin the following phase of the Championship without cards that could threaten their participation in a future game.

Candidate senses:
1. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
2. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
3. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
4. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
5. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
6. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
9. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
10. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  2. 2

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  3. 3

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  4. 4

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  5. 5

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  6. 6

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  9. 9

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  10. 10

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d006.s018.t007 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

However, the paradoxical thing about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee.

They waited for and accepted the sanction with no complaints.

Another question is what type of advantage the violators obtained in the actions deliberately carried out.

Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same game, because evidently the result of the action supposes leaving their own team with less players.

And neither is it a useful strategy for the next game, because the club will not be able to count on those players.

The advantage, obviously, consists in the fact that the players will begin the following phase of the Championship without cards that could threaten their participation in a future game.

But it is about a long term advantage, with a certain degree of indetermination, because the team can be eliminated first of change, and in addition with this action the players fulfil a sanction game and go to the second cycle of cards, in which the suspension by card accumulation takes place with one less than in the first cycle.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
However, the paradoxical thing about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee. They waited for and accepted the sanction with no complaints. Another question is what type of advantage the violators obtained in the actions deliberately carried out. Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same game, because evidently the result of the action supposes leaving their own team with less players. And neither is it a useful strategy for the next game, because the club will not be able to count on those players. The advantage, obviously, consists in the fact that the players will begin the following phase of the Championship without cards that could threaten their participation in a future <t>game</t>. But it is about a long term advantage, with a certain degree of indetermination, because the team can be eliminated first of change, and in addition with this action the players fulfil a sanction game and go to the second cycle of cards, in which the suspension by card accumulation takes place with one less than in the first cycle.

Candidate senses:
1. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games
6. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
7. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
10. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
11. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games
  6. 6

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  7. 7

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  10. 10

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  11. 11

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday

court Noun

Instance: semeval2013.d009.s005.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Scalia and Thomas dine with healthcare law challengers as court takes case

The day the Supreme Court gathered behind closed doors to consider the politically divisive question of whether it would hear a challenge to President Obama's healthcare law, two of its justices, Antonin Scalia and Clarence Thomas, were feted at a dinner sponsored by the law firm that will argue the case before the high court.

The occasion was last Thursday, when all nine justices met for a conference to pour over the petitions for review.

One of the cases at issue was a suit brought by 26 states challenging the sweeping healthcare overhaul passed by Congress last year, a law that has been a rallying cry for conservative activists nationwide.

The justices agreed to hear the suit; indeed, a landmark 5.5 - hour argument is expected in March, and the outcome is likely to further roil the 2012 presidential race, which will be in full swing by the time the court's decision is released.

The lawyer who will stand before the court and argue that the law should be thrown out is likely to be Paul Clement, who served as U.S. solicitor general during the George W. Bush administration.

Clement's law firm, Bancroft PLLC, was one of almost two dozen firms that helped sponsor the annual dinner of the Federalist Society, a longstanding group dedicated to advocating conservative legal principles.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: court
Context:
Scalia and Thomas dine with healthcare law challengers as court takes case The day the Supreme Court gathered behind closed doors to consider the politically divisive question of whether it would hear a challenge to President Obama's healthcare law, two of its justices, Antonin Scalia and Clarence Thomas, were feted at a dinner sponsored by the law firm that will argue the case before the high court. The occasion was last Thursday, when all nine justices met for a conference to pour over the petitions for review. One of the cases at issue was a suit brought by 26 states challenging the sweeping healthcare overhaul passed by Congress last year, a law that has been a rallying cry for conservative activists nationwide. The justices agreed to hear the suit; indeed, a landmark 5.5 - hour argument is expected in March, and the outcome is likely to further roil the 2012 presidential race, which will be in full swing by the time the court's decision is released. The lawyer who will stand before the <t>court</t> and argue that the law should be thrown out is likely to be Paul Clement, who served as U.S. solicitor general during the George W. Bush administration. Clement's law firm, Bancroft PLLC, was one of almost two dozen firms that helped sponsor the annual dinner of the Federalist Society, a longstanding group dedicated to advocating conservative legal principles.

Candidate senses:
1. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
2. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
3. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
4. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
5. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor
6. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
7. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
8. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
9. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  2. 2

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  3. 3

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  4. 4

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  5. 5

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

  6. 6

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  7. 7

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  8. 8

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

rule Noun

Instance: semeval2013.d009.s013.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Another sponsor was pharmaceutical giant Pfizer Inc, which has an enormous financial stake in the outcome of the litigation.

The dinner was held at a Washington hotel hours after the court's conference over the case.

In attendance was, among others, Mitch McConnell, the Senate's top Republican and an avowed opponent of the healthcare law.

The featured guests at the dinner? Scalia and Thomas.

It's nothing new: The two justices have been attending Federalist Society events for years.

And it's nothing that runs afoul of ethics rules.

In fact, justices are exempt from the Code of Conduct that governs the actions of lower federal justices.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: rule
Target surface form: rules
Context:
Another sponsor was pharmaceutical giant Pfizer Inc, which has an enormous financial stake in the outcome of the litigation. The dinner was held at a Washington hotel hours after the court's conference over the case. In attendance was, among others, Mitch McConnell, the Senate's top Republican and an avowed opponent of the healthcare law. The featured guests at the dinner? Scalia and Thomas. It's nothing new: The two justices have been attending Federalist Society events for years. And it's nothing that runs afoul of ethics <t>rules</t>. In fact, justices are exempt from the Code of Conduct that governs the actions of lower federal justices.

Candidate senses:
1. sense_key=rule%1:09:04:: | definition=(mathematics) a standard procedure for solving a class of mathematical problems | synonyms=formula | examples=he determined the upper bound with Descartes' rule of signs; he gave us a general formula for attacking polynomials
2. sense_key=rule%1:10:03:: | definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
3. sense_key=rule%1:09:00:: | definition=a principle or condition that customarily governs behavior | synonyms=regulation | examples=it was his rule to take a walk before breakfast; short haircuts were the regulation
4. sense_key=rule%1:10:01:: | definition=(linguistics) a rule describing (or prescribing) a linguistic practice | synonyms=linguistic rule
5. sense_key=rule%1:09:03:: | definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | synonyms=principle | examples=their principles of composition characterized all their works
6. sense_key=rule%1:10:00:: | definition=prescribed guide for conduct or action | synonyms=prescript
7. sense_key=rule%1:28:00:: | definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
8. sense_key=rule%1:09:02:: | definition=a rule or law concerning a natural phenomenon or the function of a complex system | synonyms=principle | examples=the principle of the conservation of mass; the principle of jet propulsion
9. sense_key=rule%1:26:00:: | definition=dominance or power through legal authority | synonyms=dominion | examples=France held undisputed dominion over vast areas of Africa; the rule of Caesar
10. sense_key=rule%1:10:02:: | definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
11. sense_key=rule%1:09:01:: | definition=something regarded as a normative example | synonyms=convention, normal, pattern, formula | examples=the convention of not naming the main character; violence is the rule not the exception
12. sense_key=rule%1:06:00:: | definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths | synonyms=ruler

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  2. 2

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic
  3. 3

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

    Selected
  4. 4

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  5. 5

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  6. 6

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

    Gold lexEN Gold Maru 2022 Gold Raganato
  7. 7

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  8. 8

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  9. 9

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

  10. 10

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
  11. 11

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

  12. 12

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler

court Noun

Instance: semeval2013.d009.s017.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

It's nothing new: The two justices have been attending Federalist Society events for years.

And it's nothing that runs afoul of ethics rules.

In fact, justices are exempt from the Code of Conduct that governs the actions of lower federal justices.

If they were, they arguably fell under code's Canon 4C, which states, "A judge may attend fund-raising events of law-related and other organizations although the judge may not be a speaker, a guest of honor, or featured on the program of such an event."

Nevertheless, the sheer proximity of Scalia and Thomas to two of the law firms in the case, as well as to a company with a massive financial interest, was enough to alarm ethics-in-government activists.

"This stunning breach of ethics and indifference to the code belies claims by several justices that the court abides by the same rules that apply to all other federal judges," said Bob Edgar, the president of Common Cause.

"The justices were wining and dining at a black-tie fundraiser with attorneys who have pending cases before the court."

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: court
Context:
It's nothing new: The two justices have been attending Federalist Society events for years. And it's nothing that runs afoul of ethics rules. In fact, justices are exempt from the Code of Conduct that governs the actions of lower federal justices. If they were, they arguably fell under code's Canon 4C, which states, "A judge may attend fund-raising events of law-related and other organizations although the judge may not be a speaker, a guest of honor, or featured on the program of such an event." Nevertheless, the sheer proximity of Scalia and Thomas to two of the law firms in the case, as well as to a company with a massive financial interest, was enough to alarm ethics-in-government activists. "This stunning breach of ethics and indifference to the code belies claims by several justices that the <t>court</t> abides by the same rules that apply to all other federal judges," said Bob Edgar, the president of Common Cause. "The justices were wining and dining at a black-tie fundraiser with attorneys who have pending cases before the court."

Candidate senses:
1. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
2. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
3. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor
4. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
5. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
7. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
8. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
9. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
10. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
11. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  2. 2

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  3. 3

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

  4. 4

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  7. 7

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  8. 8

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  9. 9

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  10. 10

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  11. 11

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

court Noun

Instance: semeval2013.d009.s018.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

And it's nothing that runs afoul of ethics rules.

In fact, justices are exempt from the Code of Conduct that governs the actions of lower federal justices.

If they were, they arguably fell under code's Canon 4C, which states, "A judge may attend fund-raising events of law-related and other organizations although the judge may not be a speaker, a guest of honor, or featured on the program of such an event."

Nevertheless, the sheer proximity of Scalia and Thomas to two of the law firms in the case, as well as to a company with a massive financial interest, was enough to alarm ethics-in-government activists.

"This stunning breach of ethics and indifference to the code belies claims by several justices that the court abides by the same rules that apply to all other federal judges," said Bob Edgar, the president of Common Cause.

"The justices were wining and dining at a black-tie fundraiser with attorneys who have pending cases before the court."

Their appearance and assistance in fundraising for this event undercuts any claims of impartiality, and is unacceptable.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: court
Context:
And it's nothing that runs afoul of ethics rules. In fact, justices are exempt from the Code of Conduct that governs the actions of lower federal justices. If they were, they arguably fell under code's Canon 4C, which states, "A judge may attend fund-raising events of law-related and other organizations although the judge may not be a speaker, a guest of honor, or featured on the program of such an event." Nevertheless, the sheer proximity of Scalia and Thomas to two of the law firms in the case, as well as to a company with a massive financial interest, was enough to alarm ethics-in-government activists. "This stunning breach of ethics and indifference to the code belies claims by several justices that the court abides by the same rules that apply to all other federal judges," said Bob Edgar, the president of Common Cause. "The justices were wining and dining at a black-tie fundraiser with attorneys who have pending cases before the <t>court</t>." Their appearance and assistance in fundraising for this event undercuts any claims of impartiality, and is unacceptable.

Candidate senses:
1. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
3. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
4. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
5. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
6. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor
7. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
9. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
10. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
11. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  3. 3

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  4. 4

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  5. 5

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  6. 6

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  9. 9

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  10. 10

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  11. 11

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected