Verified run

gpt-4.1

gpt-4.1-p001-lexen-v1-20260614

Rank
82
Accuracy lexEN v1 · WordNet fine
88.69%
Correct
4311 / 4861
Actual run cost
$6.23
Cost / M items
$1,281

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 88.69% 4311 / 4861 96.03% 4668 / 4861 93.19% 4530 / 4861
Maru 2022 (ALLamended) 86.13% 4187 / 4861 95.23% 4629 / 4861 91.75% 4460 / 4861
Raganato 2017 (original) 81.05% 3940 / 4861 93.05% 4523 / 4861 88.29% 4292 / 4861

Model

Display
gpt-4.1
Requested
gpt-4.1
Resolved
gpt-4.1-2025-04-14
Vendor
OpenAI
API provider
OpenAI
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
n/a
Model URL
n/a
Endpoint
n/a
Resolved counts
gpt-4.1-2025-04-14: 4863

Reproducibility

Created
2026-06-14T10:22:33.163281+00:00
Run schema
sensebench-run-v2
Commit
f28f64e5dce0a9d80638f4c723f4b20ba574d094
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p001
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4863
Total tokens
3,011,249
Tokens / item
619.5
Total cost
$6.23
Cost / M items
$1,281
Cost source
litellm_estimate
Elapsed
15.29s
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
2,048
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $6.23. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 2,977,208 $5.95 $2.00
Input cached 0 $0.00 $0.500
Output 34,041 $0.272 $8.00
Reasoning output 0 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 81.36% 646 794
Candidate Count 2 95.56% 817 855
Candidate Count 3-5 89.77% 1746 1945
Candidate Count 6-10 86.98% 1102 1267
POS ADJ 91.20% 601 659
POS ADV 84.62% 165 195
POS NOUN 90.96% 2635 2897
POS VERB 81.98% 910 1110
Source Dataset semeval2013 92.81% 1058 1140
Source Dataset semeval2015 89.17% 659 739
Source Dataset senseval2 89.07% 1451 1629
Source Dataset senseval3 84.48% 1143 1353

Worst-Bucket Examples

game Noun

Instance: semeval2013.d001.s009.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the <t>game</t>, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d001.s009.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the <t>game</t>. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d001.s015.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77).

In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes. However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77). In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the <t>game</t> was already won and victory escaped Tel Aviv for the first time in the season.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

figure Noun

Instance: semeval2013.d002.s002.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Wall Street closes without momentum, slowed by a strengthening dollar

The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%.

According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: figure
Target surface form: figures
Context:
Wall Street closes without momentum, slowed by a strengthening dollar The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%. According to final closing <t>figures</t>, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points. The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Candidate senses:
1. sense_key=figure%1:10:00:: | definition=a diagram or picture illustrating textual material | synonyms=fig | examples=the area covered can be seen from Figure 2
2. sense_key=figure%1:08:00:: | definition=alternative names for the body of a human being | synonyms=human body, physical body, material body, soma, build, physique | examples=Leonardo studied the human body; he has a strong physique
3. sense_key=figure%1:23:00:: | definition=one of the elements that collectively form a system of numeration | synonyms=digit | examples=0 and 1 are digits
4. sense_key=figure%1:06:00:: | definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
5. sense_key=figure%1:18:00:: | definition=a well-known or notable person | synonyms=name, public figure | examples=they studied all the great names in the history of France; she is an important figure in modern music
6. sense_key=figure%1:25:00:: | definition=a combination of points and lines and planes that form a visible palpable shape
7. sense_key=figure%1:21:00:: | definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
8. sense_key=figure%1:07:00:: | definition=the impression produced by a person | examples=he cut a fine figure; a heroic figure
9. sense_key=figure%1:07:01:: | definition=the property possessed by a sum or total or indefinite quantity of units or individuals | synonyms=number | examples=he had a number of chores to do; the number of parameters is small
10. sense_key=figure%1:10:01:: | definition=language used in a figurative or nonliteral sense | synonyms=trope, figure of speech, image
11. sense_key=figure%1:09:00:: | definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground
12. sense_key=figure%1:06:01:: | definition=a decorative or artistic work | synonyms=design, pattern | examples=the coach had a design on the doors
13. sense_key=figure%1:04:00:: | definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  2. 2

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  3. 3

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  4. 4

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  5. 5

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  6. 6

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

  7. 7

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
    Selected
  8. 8

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  9. 9

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  11. 11

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

  12. 12

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  13. 13

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures

support Noun

Instance: semeval2013.d004.s000.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

US banks repay state support

The crisis-hit US major banks are breaking free from their state shackles.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: support
Target surface form: support
Context:
US banks repay state <t>support</t> The crisis-hit US major banks are breaking free from their state shackles.

Candidate senses:
1. sense_key=support%1:04:04:: | definition=the activity of providing for or maintaining by supplying with money or necessities | examples=his support kept the family together; they gave him emotional support during difficult times
2. sense_key=support%1:04:00:: | definition=aiding the cause or policy or interests of | examples=the president no longer has the support of his own party; they developed a scheme of mutual support
3. sense_key=support%1:09:00:: | definition=something providing immaterial assistance to a person or cause or interest | examples=the policy found little public support; his faith was all the support he needed
4. sense_key=support%1:04:03:: | definition=a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission | synonyms=reinforcement, reenforcement | examples=they called for artillery support
5. sense_key=support%1:04:02:: | definition=documentary validation | synonyms=documentation | examples=his documentation of the results was excellent; the strongest support for this view is the work of Jones
6. sense_key=support%1:21:00:: | definition=the financial means whereby one lives | synonyms=keep, livelihood, living, bread and butter, sustenance | examples=each child was expected to pay for their keep; he applied to the state for support
7. sense_key=support%1:06:01:: | definition=supporting structure that holds up or provides a foundation | examples=the statue stood on a marble support
8. sense_key=support%1:04:01:: | definition=the act of bearing the weight of or strengthening | synonyms=supporting | examples=he leaned against the wall for support
9. sense_key=support%1:10:01:: | definition=a musical part (vocal or instrumental) that supports or provides background for other musical parts | synonyms=accompaniment, musical accompaniment, backup
10. sense_key=support%1:06:00:: | definition=any device that bears the weight of another thing | examples=there was no place to attach supports for a shelf
11. sense_key=support%1:21:01:: | definition=financial resources provided to make some project possible | synonyms=financial support, funding, backing, financial backing | examples=the foundation provided support for the experiment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the activity of providing for or maintaining by supplying with money or necessities

    support%1:04:04:: · support.n.01

    • his support kept the family together
    • they gave him emotional support during difficult times
    Selected
  2. 2

    aiding the cause or policy or interests of

    support%1:04:00:: · support.n.02

    • the president no longer has the support of his own party
    • they developed a scheme of mutual support
  3. 3

    something providing immaterial assistance to a person or cause or interest

    support%1:09:00:: · support.n.03

    • the policy found little public support
    • his faith was all the support he needed
  4. 4

    a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission

    support%1:04:03:: · support.n.04

    • they called for artillery support

    Synonyms: reinforcement, reenforcement

  5. 5

    documentary validation

    support%1:04:02:: · documentation.n.03

    • his documentation of the results was excellent
    • the strongest support for this view is the work of Jones

    Synonyms: documentation

  6. 6

    the financial means whereby one lives

    support%1:21:00:: · support.n.06

    • each child was expected to pay for their keep
    • he applied to the state for support

    Synonyms: keep, livelihood, living, bread and butter, sustenance

  7. 7

    supporting structure that holds up or provides a foundation

    support%1:06:01:: · support.n.07

    • the statue stood on a marble support
  8. 8

    the act of bearing the weight of or strengthening

    support%1:04:01:: · support.n.08

    • he leaned against the wall for support

    Synonyms: supporting

  9. 9

    a musical part (vocal or instrumental) that supports or provides background for other musical parts

    support%1:10:01:: · accompaniment.n.02

    Synonyms: accompaniment, musical accompaniment, backup

  10. 10

    any device that bears the weight of another thing

    support%1:06:00:: · support.n.10

    • there was no place to attach supports for a shelf
  11. 11

    financial resources provided to make some project possible

    support%1:21:01:: · support.n.11

    • the foundation provided support for the experiment

    Synonyms: financial support, funding, backing, financial backing

    Gold lexEN Gold Maru 2022 Gold Raganato

support Noun

Instance: semeval2013.d004.s003.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

US banks repay state support

The crisis-hit US major banks are breaking free from their state shackles.

On Wednesday Bank of America repaid the support from the bank protection fund TARP in the amount USD 45 billion (nearly EUR 30 billion) in one go.

And, according to reports from US broadcaster CNBC, Citigroup is also planning to repay the state support.

The institutions thereby want to wiggle themselves free from the restrictions going hand-in-hand with the acceptance of the money, such as the limits on manager bonuses and the paying of high charges.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: support
Target surface form: support
Context:
US banks repay state support The crisis-hit US major banks are breaking free from their state shackles. On Wednesday Bank of America repaid the support from the bank protection fund TARP in the amount USD 45 billion (nearly EUR 30 billion) in one go. And, according to reports from US broadcaster CNBC, Citigroup is also planning to repay the state <t>support</t>. The institutions thereby want to wiggle themselves free from the restrictions going hand-in-hand with the acceptance of the money, such as the limits on manager bonuses and the paying of high charges.

Candidate senses:
1. sense_key=support%1:04:04:: | definition=the activity of providing for or maintaining by supplying with money or necessities | examples=his support kept the family together; they gave him emotional support during difficult times
2. sense_key=support%1:04:00:: | definition=aiding the cause or policy or interests of | examples=the president no longer has the support of his own party; they developed a scheme of mutual support
3. sense_key=support%1:09:00:: | definition=something providing immaterial assistance to a person or cause or interest | examples=the policy found little public support; his faith was all the support he needed
4. sense_key=support%1:04:03:: | definition=a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission | synonyms=reinforcement, reenforcement | examples=they called for artillery support
5. sense_key=support%1:04:02:: | definition=documentary validation | synonyms=documentation | examples=his documentation of the results was excellent; the strongest support for this view is the work of Jones
6. sense_key=support%1:21:00:: | definition=the financial means whereby one lives | synonyms=keep, livelihood, living, bread and butter, sustenance | examples=each child was expected to pay for their keep; he applied to the state for support
7. sense_key=support%1:06:01:: | definition=supporting structure that holds up or provides a foundation | examples=the statue stood on a marble support
8. sense_key=support%1:04:01:: | definition=the act of bearing the weight of or strengthening | synonyms=supporting | examples=he leaned against the wall for support
9. sense_key=support%1:10:01:: | definition=a musical part (vocal or instrumental) that supports or provides background for other musical parts | synonyms=accompaniment, musical accompaniment, backup
10. sense_key=support%1:06:00:: | definition=any device that bears the weight of another thing | examples=there was no place to attach supports for a shelf
11. sense_key=support%1:21:01:: | definition=financial resources provided to make some project possible | synonyms=financial support, funding, backing, financial backing | examples=the foundation provided support for the experiment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the activity of providing for or maintaining by supplying with money or necessities

    support%1:04:04:: · support.n.01

    • his support kept the family together
    • they gave him emotional support during difficult times
    Selected
  2. 2

    aiding the cause or policy or interests of

    support%1:04:00:: · support.n.02

    • the president no longer has the support of his own party
    • they developed a scheme of mutual support
  3. 3

    something providing immaterial assistance to a person or cause or interest

    support%1:09:00:: · support.n.03

    • the policy found little public support
    • his faith was all the support he needed
  4. 4

    a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission

    support%1:04:03:: · support.n.04

    • they called for artillery support

    Synonyms: reinforcement, reenforcement

  5. 5

    documentary validation

    support%1:04:02:: · documentation.n.03

    • his documentation of the results was excellent
    • the strongest support for this view is the work of Jones

    Synonyms: documentation

  6. 6

    the financial means whereby one lives

    support%1:21:00:: · support.n.06

    • each child was expected to pay for their keep
    • he applied to the state for support

    Synonyms: keep, livelihood, living, bread and butter, sustenance

  7. 7

    supporting structure that holds up or provides a foundation

    support%1:06:01:: · support.n.07

    • the statue stood on a marble support
  8. 8

    the act of bearing the weight of or strengthening

    support%1:04:01:: · support.n.08

    • he leaned against the wall for support

    Synonyms: supporting

  9. 9

    a musical part (vocal or instrumental) that supports or provides background for other musical parts

    support%1:10:01:: · accompaniment.n.02

    Synonyms: accompaniment, musical accompaniment, backup

  10. 10

    any device that bears the weight of another thing

    support%1:06:00:: · support.n.10

    • there was no place to attach supports for a shelf
  11. 11

    financial resources provided to make some project possible

    support%1:21:01:: · support.n.11

    • the foundation provided support for the experiment

    Synonyms: financial support, funding, backing, financial backing

    Gold lexEN Gold Maru 2022 Gold Raganato

court Noun

Instance: semeval2013.d005.s005.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Cheshire Appeal Will Point to Twitter

There were half a dozen of them typing away in the courtroom rows.

Minute by minute, they sent out reports of gruesome testimony via Twitter.

In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze.

On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury.

But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years.

One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: courts
Context:
Cheshire Appeal Will Point to Twitter There were half a dozen of them typing away in the courtroom rows. Minute by minute, they sent out reports of gruesome testimony via Twitter. In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze. On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury. But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the <t>courts</t> for years. One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions.

Candidate senses:
1. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

court Noun

Instance: semeval2013.d005.s027.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But their arguments about the effect of the intense coverage of the trial may draw the most interest.

They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

They argued that the news media continually fanned the flames of emotion about the case.

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: court
Context:
But their arguments about the effect of the intense coverage of the trial may draw the most interest. They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate. They argued that the news media continually fanned the flames of emotion about the case. "The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor <t>court</t> policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Candidate senses:
1. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

court Noun

Instance: semeval2013.d005.s028.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

They argued that the news media continually fanned the flames of emotion about the case.

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Mr. Hayes's lawyers are pressing that claim.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: courts
Context:
They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate. They argued that the news media continually fanned the flames of emotion about the case. "The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the <t>courts</t>. Mr. Hayes's lawyers are pressing that claim.

Candidate senses:
1. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

rule Noun

Instance: semeval2013.d006.s007.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA.

As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase.

Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players.

The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football.

It is so extended that it part of the ethos, of the unwritten rules, but followed nonetheless by this sport.

Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: rule
Target surface form: rules
Context:
The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA. As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them. This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase. Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players. The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football. It is so extended that it part of the ethos, of the unwritten <t>rules</t>, but followed nonetheless by this sport. Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Candidate senses:
1. sense_key=rule%1:09:00:: | definition=a principle or condition that customarily governs behavior | synonyms=regulation | examples=it was his rule to take a walk before breakfast; short haircuts were the regulation
2. sense_key=rule%1:09:01:: | definition=something regarded as a normative example | synonyms=convention, normal, pattern, formula | examples=the convention of not naming the main character; violence is the rule not the exception
3. sense_key=rule%1:10:00:: | definition=prescribed guide for conduct or action | synonyms=prescript
4. sense_key=rule%1:10:01:: | definition=(linguistics) a rule describing (or prescribing) a linguistic practice | synonyms=linguistic rule
5. sense_key=rule%1:09:03:: | definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | synonyms=principle | examples=their principles of composition characterized all their works
6. sense_key=rule%1:28:00:: | definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
7. sense_key=rule%1:26:00:: | definition=dominance or power through legal authority | synonyms=dominion | examples=France held undisputed dominion over vast areas of Africa; the rule of Caesar
8. sense_key=rule%1:10:02:: | definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
9. sense_key=rule%1:10:03:: | definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
10. sense_key=rule%1:09:02:: | definition=a rule or law concerning a natural phenomenon or the function of a complex system | synonyms=principle | examples=the principle of the conservation of mass; the principle of jet propulsion
11. sense_key=rule%1:09:04:: | definition=(mathematics) a standard procedure for solving a class of mathematical problems | synonyms=formula | examples=he determined the upper bound with Descartes' rule of signs; he gave us a general formula for attacking polynomials
12. sense_key=rule%1:06:00:: | definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths | synonyms=ruler

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

    Gold Raganato Selected
  2. 2

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

  3. 3

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

  4. 4

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  5. 5

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  6. 6

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  7. 7

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

  8. 8

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
    Gold lexEN Gold Maru 2022
  9. 9

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic
  10. 10

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  11. 11

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  12. 12

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler

thing Noun

Instance: semeval2013.d006.s013.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Anyway, the debate deals with if that type of behavior not prohibited specifically by the regulation contradicts the principles of the sport, that is to say, if with these actions fraud is committed; then, indeed, they are respectful actions with the sport regulation, but they seem to elude its sense.

The matter examines the type of damage that is brought to the sporting spirit.

One of the advantages that include the sport spirit is the physical integrity of the opposite players, aspect that with these actions wasn't put into danger, that is to say, there was no violent game.

Another of these advantages to which it is alluded to with the fare-play is to avoid that the team of the lawbreaker players takes advantage unjustly of the opposite team, which did not happen either.

However, the paradoxical thing about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee.

They waited for and accepted the sanction with no complaints.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: thing
Target surface form: thing
Context:
Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician. Anyway, the debate deals with if that type of behavior not prohibited specifically by the regulation contradicts the principles of the sport, that is to say, if with these actions fraud is committed; then, indeed, they are respectful actions with the sport regulation, but they seem to elude its sense. The matter examines the type of damage that is brought to the sporting spirit. One of the advantages that include the sport spirit is the physical integrity of the opposite players, aspect that with these actions wasn't put into danger, that is to say, there was no violent game. Another of these advantages to which it is alluded to with the fare-play is to avoid that the team of the lawbreaker players takes advantage unjustly of the opposite team, which did not happen either. However, the paradoxical <t>thing</t> about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee. They waited for and accepted the sanction with no complaints.

Candidate senses:
1. sense_key=thing%1:26:00:: | definition=a special situation | examples=this thing has got to end; it is a remarkable thing
2. sense_key=thing%1:04:00:: | definition=an action | examples=how could you do such a thing?
3. sense_key=thing%1:09:00:: | definition=a special abstraction | examples=a thing of the spirit; things of the heart
4. sense_key=thing%1:06:00:: | definition=an artifact | examples=how does this thing work?
5. sense_key=thing%1:11:00:: | definition=an event | examples=a funny thing happened on the way to the...
6. sense_key=thing%1:09:02:: | definition=a vaguely specified concern | synonyms=matter, affair | examples=several matters to attend to; it is none of your affair
7. sense_key=thing%1:10:00:: | definition=a statement regarded as an object | examples=to say the same thing in other terms; how can you say such a thing?
8. sense_key=thing%1:06:01:: | definition=an entity that is not named specifically | examples=I couldn't tell what the thing was
9. sense_key=thing%1:07:00:: | definition=any attribute or quality considered as having its own existence | examples=the thing I like about her is ...
10. sense_key=thing%1:09:01:: | definition=a special objective | examples=the thing is to stay in bounds
11. sense_key=thing%1:12:00:: | definition=a persistent illogical feeling of desire or aversion | examples=he has a thing about seafood; she has a thing about him
12. sense_key=thing%1:03:00:: | definition=a separate and self-contained entity

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a special situation

    thing%1:26:00:: · thing.n.01

    • this thing has got to end
    • it is a remarkable thing
    Selected
  2. 2

    an action

    thing%1:04:00:: · thing.n.02

    • how could you do such a thing?
  3. 3

    a special abstraction

    thing%1:09:00:: · thing.n.03

    • a thing of the spirit
    • things of the heart
  4. 4

    an artifact

    thing%1:06:00:: · thing.n.04

    • how does this thing work?
  5. 5

    an event

    thing%1:11:00:: · thing.n.05

    • a funny thing happened on the way to the...
  6. 6

    a vaguely specified concern

    thing%1:09:02:: · matter.n.01

    • several matters to attend to
    • it is none of your affair

    Synonyms: matter, affair

  7. 7

    a statement regarded as an object

    thing%1:10:00:: · thing.n.07

    • to say the same thing in other terms
    • how can you say such a thing?
  8. 8

    an entity that is not named specifically

    thing%1:06:01:: · thing.n.08

    • I couldn't tell what the thing was
  9. 9

    any attribute or quality considered as having its own existence

    thing%1:07:00:: · thing.n.09

    • the thing I like about her is ...
    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    a special objective

    thing%1:09:01:: · thing.n.10

    • the thing is to stay in bounds
  11. 11

    a persistent illogical feeling of desire or aversion

    thing%1:12:00:: · thing.n.11

    • he has a thing about seafood
    • she has a thing about him
  12. 12

    a separate and self-contained entity

    thing%1:03:00:: · thing.n.12

game Noun

Instance: semeval2013.d006.s016.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

One of the advantages that include the sport spirit is the physical integrity of the opposite players, aspect that with these actions wasn't put into danger, that is to say, there was no violent game.

Another of these advantages to which it is alluded to with the fare-play is to avoid that the team of the lawbreaker players takes advantage unjustly of the opposite team, which did not happen either.

However, the paradoxical thing about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee.

They waited for and accepted the sanction with no complaints.

Another question is what type of advantage the violators obtained in the actions deliberately carried out.

Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same game, because evidently the result of the action supposes leaving their own team with less players.

And neither is it a useful strategy for the next game, because the club will not be able to count on those players.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
One of the advantages that include the sport spirit is the physical integrity of the opposite players, aspect that with these actions wasn't put into danger, that is to say, there was no violent game. Another of these advantages to which it is alluded to with the fare-play is to avoid that the team of the lawbreaker players takes advantage unjustly of the opposite team, which did not happen either. However, the paradoxical thing about the action of the players of Real Madrid is that it did not comply to what we normally characterize as legal fraud, because the violation of the rules was not made secretly as to try to avoid the sanction, but their action was most evident and thus they received punishment from the referee. They waited for and accepted the sanction with no complaints. Another question is what type of advantage the violators obtained in the actions deliberately carried out. Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same <t>game</t>, because evidently the result of the action supposes leaving their own team with less players. And neither is it a useful strategy for the next game, because the club will not be able to count on those players.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games