Verified run

claude-haiku-5-5

claude-haiku-5.5-max-reasoning-p001-lexen-v1-20261009-128000tokens

Rank
56
Accuracy lexEN v1 · WordNet fine
92.90%
Correct
4516 / 4861
Actual run cost
$2.66
Cost / M items
$548

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 92.90% 4516 / 4861 97.41% 4735 / 4861 95.37% 4636 / 4861
Maru 2022 (ALLamended) 89.53% 4352 / 4861 96.15% 4674 / 4861 93.31% 4536 / 4861
Raganato 2017 (original) 83.36% 4052 / 4861 93.58% 4549 / 4861 89.32% 4342 / 4861

Model

Display
claude-haiku-5-5
Requested
claude-haiku-5-5
Resolved
claude-haiku-5-5
Vendor
Anthropic
API provider
Anthropic
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
max
Model URL
n/a
Endpoint
n/a
Resolved counts
claude-haiku-5-5: 4861

Reproducibility

Created
2026-10-09T13:10:20.543118+00:00
Run schema
sensebench-run-v2
Commit
9040664a78ce4afacbe5400eaf6538ee664f3dea
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p001
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
8,860,909
Tokens / item
1,822.9
Total cost
$2.66
Cost / M items
$548
Cost source
litellm_estimate
Elapsed
13.70m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
128,000
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $2.66. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 4,417,330 $0.442 $0.100
Input cached 0 $0.00 $0.0100
Output 4,443,579 $2.22 $0.500
Reasoning output 0 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 90.93% 722 794
Candidate Count 2 96.02% 821 855
Candidate Count 3-5 92.49% 1799 1945
Candidate Count 6-10 92.66% 1174 1267
POS ADJ 92.11% 607 659
POS ADV 91.79% 179 195
POS NOUN 93.72% 2715 2897
POS VERB 91.44% 1015 1110
Source Dataset semeval2013 95.70% 1091 1140
Source Dataset semeval2015 91.47% 676 739
Source Dataset senseval2 92.76% 1511 1629
Source Dataset senseval3 91.50% 1238 1353

Worst-Bucket Examples

game Noun

Instance: semeval2013.d001.s009.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the <t>game</t>. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

figure Noun

Instance: semeval2013.d002.s002.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Wall Street closes without momentum, slowed by a strengthening dollar

The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%.

According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: figure
Target surface form: figures
Context:
Wall Street closes without momentum, slowed by a strengthening dollar The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%. According to final closing <t>figures</t>, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points. The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Candidate senses:
1. sense_key=figure%1:10:00:: | definition=a diagram or picture illustrating textual material | synonyms=fig | examples=the area covered can be seen from Figure 2
2. sense_key=figure%1:08:00:: | definition=alternative names for the body of a human being | synonyms=human body, physical body, material body, soma, build, physique | examples=Leonardo studied the human body; he has a strong physique
3. sense_key=figure%1:23:00:: | definition=one of the elements that collectively form a system of numeration | synonyms=digit | examples=0 and 1 are digits
4. sense_key=figure%1:06:00:: | definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
5. sense_key=figure%1:18:00:: | definition=a well-known or notable person | synonyms=name, public figure | examples=they studied all the great names in the history of France; she is an important figure in modern music
6. sense_key=figure%1:25:00:: | definition=a combination of points and lines and planes that form a visible palpable shape
7. sense_key=figure%1:21:00:: | definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
8. sense_key=figure%1:07:00:: | definition=the impression produced by a person | examples=he cut a fine figure; a heroic figure
9. sense_key=figure%1:07:01:: | definition=the property possessed by a sum or total or indefinite quantity of units or individuals | synonyms=number | examples=he had a number of chores to do; the number of parameters is small
10. sense_key=figure%1:10:01:: | definition=language used in a figurative or nonliteral sense | synonyms=trope, figure of speech, image
11. sense_key=figure%1:09:00:: | definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground
12. sense_key=figure%1:06:01:: | definition=a decorative or artistic work | synonyms=design, pattern | examples=the coach had a design on the doors
13. sense_key=figure%1:04:00:: | definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  2. 2

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  3. 3

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  4. 4

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  5. 5

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  6. 6

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

  7. 7

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
    Selected
  8. 8

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  9. 9

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  11. 11

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

  12. 12

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  13. 13

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures

rule Noun

Instance: semeval2013.d005.s030.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Mr. Hayes's lawyers are pressing that claim.

In their filing, they referred to the Supreme Court's 1966 decision overturning Dr. Sheppard's conviction because of the trial coverage and made it clear they would claim that the new media required new rules.

"This case," they wrote, "represents the Sheppard v. Maxwell of the 21st century."

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: rule
Target surface form: rules
Context:
"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts. Mr. Hayes's lawyers are pressing that claim. In their filing, they referred to the Supreme Court's 1966 decision overturning Dr. Sheppard's conviction because of the trial coverage and made it clear they would claim that the new media required new <t>rules</t>. "This case," they wrote, "represents the Sheppard v. Maxwell of the 21st century."

Candidate senses:
1. sense_key=rule%1:09:00:: | definition=a principle or condition that customarily governs behavior | synonyms=regulation | examples=it was his rule to take a walk before breakfast; short haircuts were the regulation
2. sense_key=rule%1:09:01:: | definition=something regarded as a normative example | synonyms=convention, normal, pattern, formula | examples=the convention of not naming the main character; violence is the rule not the exception
3. sense_key=rule%1:10:00:: | definition=prescribed guide for conduct or action | synonyms=prescript
4. sense_key=rule%1:10:01:: | definition=(linguistics) a rule describing (or prescribing) a linguistic practice | synonyms=linguistic rule
5. sense_key=rule%1:09:03:: | definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | synonyms=principle | examples=their principles of composition characterized all their works
6. sense_key=rule%1:28:00:: | definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
7. sense_key=rule%1:26:00:: | definition=dominance or power through legal authority | synonyms=dominion | examples=France held undisputed dominion over vast areas of Africa; the rule of Caesar
8. sense_key=rule%1:10:02:: | definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
9. sense_key=rule%1:10:03:: | definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
10. sense_key=rule%1:09:02:: | definition=a rule or law concerning a natural phenomenon or the function of a complex system | synonyms=principle | examples=the principle of the conservation of mass; the principle of jet propulsion
11. sense_key=rule%1:09:04:: | definition=(mathematics) a standard procedure for solving a class of mathematical problems | synonyms=formula | examples=he determined the upper bound with Descartes' rule of signs; he gave us a general formula for attacking polynomials
12. sense_key=rule%1:06:00:: | definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths | synonyms=ruler

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

    Gold Raganato Selected
  2. 2

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

  3. 3

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  5. 5

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  6. 6

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  7. 7

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

  8. 8

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
  9. 9

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic
  10. 10

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  11. 11

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  12. 12

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler

rule Noun

Instance: semeval2013.d006.s007.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA.

As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase.

Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players.

The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football.

It is so extended that it part of the ethos, of the unwritten rules, but followed nonetheless by this sport.

Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: rule
Target surface form: rules
Context:
The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA. As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them. This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase. Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players. The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football. It is so extended that it part of the ethos, of the unwritten <t>rules</t>, but followed nonetheless by this sport. Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Candidate senses:
1. sense_key=rule%1:09:00:: | definition=a principle or condition that customarily governs behavior | synonyms=regulation | examples=it was his rule to take a walk before breakfast; short haircuts were the regulation
2. sense_key=rule%1:09:01:: | definition=something regarded as a normative example | synonyms=convention, normal, pattern, formula | examples=the convention of not naming the main character; violence is the rule not the exception
3. sense_key=rule%1:10:00:: | definition=prescribed guide for conduct or action | synonyms=prescript
4. sense_key=rule%1:10:01:: | definition=(linguistics) a rule describing (or prescribing) a linguistic practice | synonyms=linguistic rule
5. sense_key=rule%1:09:03:: | definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | synonyms=principle | examples=their principles of composition characterized all their works
6. sense_key=rule%1:28:00:: | definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
7. sense_key=rule%1:26:00:: | definition=dominance or power through legal authority | synonyms=dominion | examples=France held undisputed dominion over vast areas of Africa; the rule of Caesar
8. sense_key=rule%1:10:02:: | definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
9. sense_key=rule%1:10:03:: | definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
10. sense_key=rule%1:09:02:: | definition=a rule or law concerning a natural phenomenon or the function of a complex system | synonyms=principle | examples=the principle of the conservation of mass; the principle of jet propulsion
11. sense_key=rule%1:09:04:: | definition=(mathematics) a standard procedure for solving a class of mathematical problems | synonyms=formula | examples=he determined the upper bound with Descartes' rule of signs; he gave us a general formula for attacking polynomials
12. sense_key=rule%1:06:00:: | definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths | synonyms=ruler

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

    Gold Raganato Selected
  2. 2

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

  3. 3

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

  4. 4

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  5. 5

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  6. 6

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  7. 7

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

  8. 8

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
    Gold lexEN Gold Maru 2022
  9. 9

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic
  10. 10

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  11. 11

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  12. 12

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler

case Noun

Instance: semeval2013.d006.s008.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase.

Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players.

The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football.

It is so extended that it part of the ethos, of the unwritten rules, but followed nonetheless by this sport.

Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Anyway, the debate deals with if that type of behavior not prohibited specifically by the regulation contradicts the principles of the sport, that is to say, if with these actions fraud is committed; then, indeed, they are respectful actions with the sport regulation, but they seem to elude its sense.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: case
Target surface form: case
Context:
As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them. This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase. Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players. The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football. It is so extended that it part of the ethos, of the unwritten rules, but followed nonetheless by this sport. Part of the debate arisen in the related <t>case</t> is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician. Anyway, the debate deals with if that type of behavior not prohibited specifically by the regulation contradicts the principles of the sport, that is to say, if with these actions fraud is committed; then, indeed, they are respectful actions with the sport regulation, but they seem to elude its sense.

Candidate senses:
1. sense_key=case%1:11:00:: | definition=an occurrence of something | synonyms=instance, example | examples=it was a case of bad judgment; another instance occurred yesterday
2. sense_key=case%1:26:00:: | definition=a special set of circumstances | synonyms=event | examples=in that event, the first possibility is excluded; it may rain in which case the picnic will be canceled
3. sense_key=case%1:04:00:: | definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | synonyms=lawsuit, suit, cause, causa | examples=the family brought suit against the landlord
4. sense_key=case%1:09:00:: | definition=the actual state of things | examples=that was not the case
5. sense_key=case%1:06:00:: | definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. sense_key=case%1:18:03:: | definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. sense_key=case%1:18:02:: | definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | synonyms=subject, guinea pig | examples=the subjects for this investigation were selected randomly; the cases that we studied were drawn from two different communities
8. sense_key=case%1:10:02:: | definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. sense_key=case%1:10:01:: | definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. sense_key=case%1:23:00:: | definition=the quantity contained in a case | synonyms=caseful
11. sense_key=case%1:10:00:: | definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence | synonyms=grammatical case
12. sense_key=case%1:26:02:: | definition=a specific state of mind that is temporary | examples=a case of the jitters
13. sense_key=case%1:18:04:: | definition=a person of a specified kind (usually with many eccentricities) | synonyms=character, eccentric, type | examples=a real character; a strange character
14. sense_key=case%1:10:03:: | definition=a specific size and style of type within a type family | synonyms=font, fount, typeface, face
15. sense_key=case%1:08:00:: | definition=an enveloping structure or covering enclosing an animal or plant organ or part | synonyms=sheath
16. sense_key=case%1:06:06:: | definition=the housing or outer covering of something | synonyms=shell, casing | examples=the clock has a walnut case
17. sense_key=case%1:06:07:: | definition=the enclosing frame around a door or window opening | synonyms=casing | examples=the casings had rotted away and had to be replaced
18. sense_key=case%1:06:03:: | definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | synonyms=compositor's case, typesetter's case | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. sense_key=case%1:06:02:: | definition=bed linen consisting of a cover for a pillow | synonyms=pillowcase, slip, pillow slip | examples=the burglar carried his loot in a pillowcase
20. sense_key=case%1:06:01:: | definition=a glass container used to store and display items in a shop or museum or home | synonyms=display case, showcase, vitrine

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

  3. 3

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

  4. 4

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
  5. 5

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  6. 6

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  7. 7

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  8. 8

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
    Selected
  9. 9

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  10. 10

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  11. 11

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  12. 12

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
  13. 13

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  14. 14

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

  15. 15

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  16. 16

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  17. 17

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  18. 18

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  19. 19

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  20. 20

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine

life Noun

Instance: semeval2013.d007.s006.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The discovery of a strange bacteria that can use arsenic as one of its nutrients widens the scope for finding new forms of life on Earth and possibly beyond.

While researchers discovered the unusual bacteria here in Earth, they say it shows that life has possibilities beyond the major elements that have been considered essential.

"This organism has dual capability."

"It can grow with either phosphorus or arsenic."

"That makes it very peculiar, though it falls short of being some form of truly 'alien' life," commented Paul C. W. Davies of Arizona State University, a co-author of the report appearing in Thursday's online edition of the journal Science.

Six major elements have long been considered essential for life - carbon, hydrogen, nitrogen, oxygen, phosphorus and sulfur.

But the researchers found that the bacteria, discovered in Mono Lake, Calif., is able to continue to grow after substituting arsenic for phosphorus.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: life
Target surface form: life
Context:
The discovery of a strange bacteria that can use arsenic as one of its nutrients widens the scope for finding new forms of life on Earth and possibly beyond. While researchers discovered the unusual bacteria here in Earth, they say it shows that life has possibilities beyond the major elements that have been considered essential. "This organism has dual capability." "It can grow with either phosphorus or arsenic." "That makes it very peculiar, though it falls short of being some form of truly 'alien' life," commented Paul C. W. Davies of Arizona State University, a co-author of the report appearing in Thursday's online edition of the journal Science. Six major elements have long been considered essential for <t>life</t> - carbon, hydrogen, nitrogen, oxygen, phosphorus and sulfur. But the researchers found that the bacteria, discovered in Mono Lake, Calif., is able to continue to grow after substituting arsenic for phosphorus.

Candidate senses:
1. sense_key=life%1:26:01:: | definition=a characteristic state or mode of living | examples=social life; city life
2. sense_key=life%1:09:00:: | definition=the experience of being alive; the course of human events and activities | synonyms=living | examples=he could no longer cope with the complexities of life
3. sense_key=life%1:26:02:: | definition=the course of existence of an individual; the actions and events that occur in living | examples=he hoped for a new life in Australia; he wanted to live his own life without interference from others
4. sense_key=life%1:26:00:: | definition=the condition of living or the state of being alive | synonyms=animation, living, aliveness | examples=while there's life there's hope; life depends on many chemical and physical processes
5. sense_key=life%1:28:00:: | definition=the period during which something is functional (as between birth and death) | synonyms=lifetime, lifespan | examples=the battery had a short life; he lived a long and happy life
6. sense_key=life%1:28:01:: | definition=the period between birth and the present time | examples=I have known him all his life
7. sense_key=life%1:28:02:: | definition=the period from the present until death | examples=he appointed himself emperor for life
8. sense_key=life%1:18:00:: | definition=a living person | examples=his heroism saved a life
9. sense_key=life%1:07:01:: | definition=animation and energy in action or expression | synonyms=liveliness, spirit, sprightliness | examples=it was a heavy play and the actors tried in vain to give life to it
10. sense_key=life%1:03:00:: | definition=living things collectively | examples=the oceans are teeming with life
11. sense_key=life%1:19:00:: | definition=the organic phenomenon that distinguishes living organisms from nonliving ones | examples=there is no life on the moon
12. sense_key=life%1:10:00:: | definition=an account of the series of events making up a person's life | synonyms=biography, life story, life history
13. sense_key=life%1:16:00:: | definition=a motive for living | examples=pottery was his life
14. sense_key=life%1:28:03:: | definition=a prison term lasting as long as the prisoner lives | synonyms=life sentence | examples=he got life for killing the guard

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a characteristic state or mode of living

    life%1:26:01:: · life.n.01

    • social life
    • city life
  2. 2

    the experience of being alive; the course of human events and activities

    life%1:09:00:: · life.n.02

    • he could no longer cope with the complexities of life

    Synonyms: living

  3. 3

    the course of existence of an individual; the actions and events that occur in living

    life%1:26:02:: · life.n.03

    • he hoped for a new life in Australia
    • he wanted to live his own life without interference from others
  4. 4

    the condition of living or the state of being alive

    life%1:26:00:: · animation.n.01

    • while there's life there's hope
    • life depends on many chemical and physical processes

    Synonyms: animation, living, aliveness

    Selected
  5. 5

    the period during which something is functional (as between birth and death)

    life%1:28:00:: · life.n.05

    • the battery had a short life
    • he lived a long and happy life

    Synonyms: lifetime, lifespan

  6. 6

    the period between birth and the present time

    life%1:28:01:: · life.n.06

    • I have known him all his life
  7. 7

    the period from the present until death

    life%1:28:02:: · life.n.07

    • he appointed himself emperor for life
  8. 8

    a living person

    life%1:18:00:: · life.n.08

    • his heroism saved a life
  9. 9

    animation and energy in action or expression

    life%1:07:01:: · liveliness.n.02

    • it was a heavy play and the actors tried in vain to give life to it

    Synonyms: liveliness, spirit, sprightliness

  10. 10

    living things collectively

    life%1:03:00:: · life.n.10

    • the oceans are teeming with life
  11. 11

    the organic phenomenon that distinguishes living organisms from nonliving ones

    life%1:19:00:: · life.n.11

    • there is no life on the moon
    Gold lexEN Gold Maru 2022 Gold Raganato
  12. 12

    an account of the series of events making up a person's life

    life%1:10:00:: · biography.n.01

    Synonyms: biography, life story, life history

  13. 13

    a motive for living

    life%1:16:00:: · life.n.13

    • pottery was his life
  14. 14

    a prison term lasting as long as the prisoner lives

    life%1:28:03:: · life_sentence.n.01

    • he got life for killing the guard

    Synonyms: life sentence

figure Noun

Instance: semeval2013.d008.s013.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The second is the increasing stability of attitudes towards democracy and its core institutions.

Support for democracy has risen noticeably in several countries on the Pacific rim of South America (see table 1).

For example in Peru, where economic growth has averaged 6% a year since 2002, support for democracy has risen from a low of 40% in 2005 to 61% this year.

It also rose in Mexico, where the economy has recovered after suffering a big drop in output last year.

But only around half of respondents in Mexico and Brazil, the region's two most populous countries, are convinced democrats, which drags down the regional average (see chart 2).

Some 44% of respondents across the region pronounced themselves satisfied with how their country's democracy works in practice, the same figure as last year but a big increase on the 25% in 2001 (chart 3).

Some 34% said they had confidence in their country's Congress and 45% in their government, the same as last year in both cases but up sharply from 2003 (17% and 24% respectively).

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: figure
Target surface form: figure
Context:
The second is the increasing stability of attitudes towards democracy and its core institutions. Support for democracy has risen noticeably in several countries on the Pacific rim of South America (see table 1). For example in Peru, where economic growth has averaged 6% a year since 2002, support for democracy has risen from a low of 40% in 2005 to 61% this year. It also rose in Mexico, where the economy has recovered after suffering a big drop in output last year. But only around half of respondents in Mexico and Brazil, the region's two most populous countries, are convinced democrats, which drags down the regional average (see chart 2). Some 44% of respondents across the region pronounced themselves satisfied with how their country's democracy works in practice, the same <t>figure</t> as last year but a big increase on the 25% in 2001 (chart 3). Some 34% said they had confidence in their country's Congress and 45% in their government, the same as last year in both cases but up sharply from 2003 (17% and 24% respectively).

Candidate senses:
1. sense_key=figure%1:10:00:: | definition=a diagram or picture illustrating textual material | synonyms=fig | examples=the area covered can be seen from Figure 2
2. sense_key=figure%1:08:00:: | definition=alternative names for the body of a human being | synonyms=human body, physical body, material body, soma, build, physique | examples=Leonardo studied the human body; he has a strong physique
3. sense_key=figure%1:23:00:: | definition=one of the elements that collectively form a system of numeration | synonyms=digit | examples=0 and 1 are digits
4. sense_key=figure%1:06:00:: | definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
5. sense_key=figure%1:18:00:: | definition=a well-known or notable person | synonyms=name, public figure | examples=they studied all the great names in the history of France; she is an important figure in modern music
6. sense_key=figure%1:25:00:: | definition=a combination of points and lines and planes that form a visible palpable shape
7. sense_key=figure%1:21:00:: | definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
8. sense_key=figure%1:07:00:: | definition=the impression produced by a person | examples=he cut a fine figure; a heroic figure
9. sense_key=figure%1:07:01:: | definition=the property possessed by a sum or total or indefinite quantity of units or individuals | synonyms=number | examples=he had a number of chores to do; the number of parameters is small
10. sense_key=figure%1:10:01:: | definition=language used in a figurative or nonliteral sense | synonyms=trope, figure of speech, image
11. sense_key=figure%1:09:00:: | definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground
12. sense_key=figure%1:06:01:: | definition=a decorative or artistic work | synonyms=design, pattern | examples=the coach had a design on the doors
13. sense_key=figure%1:04:00:: | definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  2. 2

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  3. 3

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  4. 4

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  5. 5

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  6. 6

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

  7. 7

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
    Selected
  8. 8

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  9. 9

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  11. 11

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

  12. 12

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  13. 13

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures

see Verb

Instance: semeval2015.d000.s020.t002 Dataset: semeval2015 Bucket: Candidate Count / 11+

Incorrect

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta.

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: see
Target surface form: see
Context:
It is given once every three weeks as an intravenous infusion lasting 10 minutes. To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta. When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, <t>see</t> the Summary of Product Characteristics (also part of the EPAR). How does Alimta work?

Candidate senses:
1. sense_key=see%2:39:00:: | definition=perceive by sight or have the power to perceive by sight | examples=You have to be a good observer to see all the details; Can you see the bird in that tree?
2. sense_key=see%2:31:01:: | definition=perceive (an idea or situation) mentally | synonyms=understand, realize, realise | examples=Now I see!; I just can't see your point
3. sense_key=see%2:39:02:: | definition=perceive or be contemporaneous with | synonyms=witness, find | examples=We found Republicans winning the offices; You'll see a lot of cheating in this school
4. sense_key=see%2:36:00:: | definition=imagine; conceive of; see in one's mind | synonyms=visualize, visualise, envision, project, fancy, figure | examples=I can't see him on horseback!; I can see what will happen
5. sense_key=see%2:31:00:: | definition=deem to be | synonyms=consider, reckon, view, regard | examples=She views this quite differently from me; I consider her to be shallow
6. sense_key=see%2:31:02:: | definition=get to know or become aware of, usually accidentally | synonyms=learn, hear, get word, get wind, pick up, find out | examples=I learned that she has two grown-up children; I see that you have been promoted
7. sense_key=see%2:39:03:: | definition=see or watch | synonyms=watch, view, catch, take in | examples=view a show on television; This program will be seen all over the world
8. sense_key=see%2:38:00:: | definition=come together | synonyms=meet, run into, encounter, run across, come across | examples=I'll probably see you at the meeting; How nice to see you again!
9. sense_key=see%2:32:00:: | definition=find out, learn, or determine with certainty, usually by making an inquiry or other effort | synonyms=determine, check, find out, ascertain, watch, learn | examples=I want to see whether she speaks French; See whether it works
10. sense_key=see%2:31:03:: | definition=be careful or certain to do something; make certain of something | synonyms=check, insure, see to it, ensure, control, ascertain | examples=He verified that the valves were closed; See that the curtains are closed
11. sense_key=see%2:41:11:: | definition=go to see for professional or business reasons | examples=You should see a lawyer; We had to see a psychiatrist
12. sense_key=see%2:41:12:: | definition=go to see for a social visit | examples=I went to see my friend Mary the other day
13. sense_key=see%2:41:10:: | definition=go to see a place, as for entertainment | synonyms=visit | examples=We went to see the Eiffel Tower in the morning
14. sense_key=see%2:41:14:: | definition=take charge of or deal with | synonyms=attend, take care, look | examples=Could you see about lunch?; I must attend to this matter
15. sense_key=see%2:35:09:: | definition=receive as a specified guest | examples=the doctor will see you now; The minister doesn't see anybody before noon
16. sense_key=see%2:41:00:: | definition=date regularly; have a steady relationship with | synonyms=go steady, go out, date | examples=Did you know that she is seeing an older man?; He is dating his former wife again!
17. sense_key=see%2:39:05:: | definition=see and understand, have a good eye | examples=The artist must first learn to see
18. sense_key=see%2:31:08:: | definition=deliberate or decide | examples=See whether you can come tomorrow; let's see--which movie should we see tonight?
19. sense_key=see%2:39:11:: | definition=observe as if with an eye | examples=The camera saw the burglary and recorded it
20. sense_key=see%2:39:13:: | definition=observe, check out, and look over carefully or inspect | synonyms=examine | examples=The customs agent examined the baggage; I must see your passport before you can enter the country
21. sense_key=see%2:39:12:: | definition=go or live through | synonyms=experience, go through | examples=We had many trials to go through; he saw action in Viet Nam
22. sense_key=see%2:38:03:: | definition=accompany or escort | synonyms=escort | examples=I'll see you to the door
23. sense_key=see%2:33:00:: | definition=match or meet | examples=I saw the bet of one of my fellow players
24. sense_key=see%2:31:13:: | definition=make sense of; assign a meaning to | synonyms=interpret, construe | examples=What message do you see in this letter?; How do you interpret his behavior?

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    perceive by sight or have the power to perceive by sight

    see%2:39:00:: · see.v.01

    • You have to be a good observer to see all the details
    • Can you see the bird in that tree?
  2. 2

    perceive (an idea or situation) mentally

    see%2:31:01:: · understand.v.02

    • Now I see!
    • I just can't see your point

    Synonyms: understand, realize, realise

  3. 3

    perceive or be contemporaneous with

    see%2:39:02:: · witness.v.02

    • We found Republicans winning the offices
    • You'll see a lot of cheating in this school

    Synonyms: witness, find

  4. 4

    imagine; conceive of; see in one's mind

    see%2:36:00:: · visualize.v.01

    • I can't see him on horseback!
    • I can see what will happen

    Synonyms: visualize, visualise, envision, project, fancy, figure, picture, image

  5. 5

    deem to be

    see%2:31:00:: · see.v.05

    • She views this quite differently from me
    • I consider her to be shallow

    Synonyms: consider, reckon, view, regard

  6. 6

    get to know or become aware of, usually accidentally

    see%2:31:02:: · learn.v.02

    • I learned that she has two grown-up children
    • I see that you have been promoted

    Synonyms: learn, hear, get word, get wind, pick up, find out, get a line, discover

  7. 7

    see or watch

    see%2:39:03:: · watch.v.03

    • view a show on television
    • This program will be seen all over the world

    Synonyms: watch, view, catch, take in

  8. 8

    come together

    see%2:38:00:: · meet.v.01

    • I'll probably see you at the meeting
    • How nice to see you again!

    Synonyms: meet, run into, encounter, run across, come across

  9. 9

    find out, learn, or determine with certainty, usually by making an inquiry or other effort

    see%2:32:00:: · determine.v.08

    • I want to see whether she speaks French
    • See whether it works

    Synonyms: determine, check, find out, ascertain, watch, learn

    Selected
  10. 10

    be careful or certain to do something; make certain of something

    see%2:31:03:: · see.v.10

    • He verified that the valves were closed
    • See that the curtains are closed

    Synonyms: check, insure, see to it, ensure, control, ascertain, assure

  11. 11

    go to see for professional or business reasons

    see%2:41:11:: · see.v.11

    • You should see a lawyer
    • We had to see a psychiatrist
  12. 12

    go to see for a social visit

    see%2:41:12:: · see.v.12

    • I went to see my friend Mary the other day
  13. 13

    go to see a place, as for entertainment

    see%2:41:10:: · visit.v.01

    • We went to see the Eiffel Tower in the morning

    Synonyms: visit

  14. 14

    take charge of or deal with

    see%2:41:14:: · attend.v.02

    • Could you see about lunch?
    • I must attend to this matter

    Synonyms: attend, take care, look

  15. 15

    receive as a specified guest

    see%2:35:09:: · see.v.15

    • the doctor will see you now
    • The minister doesn't see anybody before noon
  16. 16

    date regularly; have a steady relationship with

    see%2:41:00:: · go_steady.v.01

    • Did you know that she is seeing an older man?
    • He is dating his former wife again!

    Synonyms: go steady, go out, date

  17. 17

    see and understand, have a good eye

    see%2:39:05:: · see.v.17

    • The artist must first learn to see
  18. 18

    deliberate or decide

    see%2:31:08:: · see.v.18

    • See whether you can come tomorrow
    • let's see--which movie should we see tonight?
  19. 19

    observe as if with an eye

    see%2:39:11:: · see.v.19

    • The camera saw the burglary and recorded it
  20. 20

    observe, check out, and look over carefully or inspect

    see%2:39:13:: · examine.v.02

    • The customs agent examined the baggage
    • I must see your passport before you can enter the country

    Synonyms: examine

    Gold lexEN Gold Maru 2022 Gold Raganato
  21. 21

    go or live through

    see%2:39:12:: · experience.v.01

    • We had many trials to go through
    • he saw action in Viet Nam

    Synonyms: experience, go through

  22. 22

    accompany or escort

    see%2:38:03:: · see.v.22

    • I'll see you to the door

    Synonyms: escort

  23. 23

    match or meet

    see%2:33:00:: · see.v.23

    • I saw the bet of one of my fellow players
  24. 24

    make sense of; assign a meaning to

    see%2:31:13:: · interpret.v.01

    • What message do you see in this letter?
    • How do you interpret his behavior?

    Synonyms: interpret, construe

convert Verb

Instance: semeval2015.d000.s023.t001 Dataset: semeval2015 Bucket: Candidate Count / 11+

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: convert
Target surface form: converted
Context:
Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is <t>converted</t> into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied?

Candidate senses:
1. sense_key=convert%2:30:00:: | definition=change from one system to another or to a new plan or policy | synonyms=change over | examples=We converted from 220 to 110 Volt
2. sense_key=convert%2:30:03:: | definition=change the nature, purpose, or function of something | examples=convert lead into gold; convert hotels into jails
3. sense_key=convert%2:30:01:: | definition=change religious beliefs, or adopt a religious belief | examples=She converted to Buddhism
4. sense_key=convert%2:30:02:: | definition=exchange or replace with another, usually of the same kind or category | synonyms=change, exchange, commute | examples=Could you convert my dollars into pounds?; He changed his name
5. sense_key=convert%2:30:07:: | definition=cause to adopt a new or different faith | examples=The missionaries converted the Indian population
6. sense_key=convert%2:33:02:: | definition=score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone | examples=Smith converted and his team won
7. sense_key=convert%2:33:01:: | definition=complete successfully | examples=score a penalty shot or free throw
8. sense_key=convert%2:33:00:: | definition=score (a spare)
9. sense_key=convert%2:32:00:: | definition=make (someone) agree, understand, or realize the truth or validity of something | synonyms=win over, convince | examples=He had finally convinced several customers of the advantages of his product
10. sense_key=convert%2:30:09:: | definition=exchange a penalty for a less severe one | synonyms=commute, exchange
11. sense_key=convert%2:30:04:: | definition=change in nature, purpose, or function; undergo a chemical change | examples=The substance converts to an acid

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    change from one system to another or to a new plan or policy

    convert%2:30:00:: · convert.v.01

    • We converted from 220 to 110 Volt

    Synonyms: change over

  2. 2

    change the nature, purpose, or function of something

    convert%2:30:03:: · convert.v.02

    • convert lead into gold
    • convert hotels into jails
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    change religious beliefs, or adopt a religious belief

    convert%2:30:01:: · convert.v.03

    • She converted to Buddhism
  4. 4

    exchange or replace with another, usually of the same kind or category

    convert%2:30:02:: · change.v.06

    • Could you convert my dollars into pounds?
    • He changed his name

    Synonyms: change, exchange, commute

  5. 5

    cause to adopt a new or different faith

    convert%2:30:07:: · convert.v.05

    • The missionaries converted the Indian population
  6. 6

    score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone

    convert%2:33:02:: · convert.v.06

    • Smith converted and his team won
  7. 7

    complete successfully

    convert%2:33:01:: · convert.v.07

    • score a penalty shot or free throw
  8. 8

    score (a spare)

    convert%2:33:00:: · convert.v.08

  9. 9

    make (someone) agree, understand, or realize the truth or validity of something

    convert%2:32:00:: · convert.v.09

    • He had finally convinced several customers of the advantages of his product

    Synonyms: win over, convince

  10. 10

    exchange a penalty for a less severe one

    convert%2:30:09:: · commute.v.04

    Synonyms: commute, exchange

  11. 11

    change in nature, purpose, or function; undergo a chemical change

    convert%2:30:04:: · convert.v.11

    • The substance converts to an acid
    Gold Raganato Selected

block Verb

Instance: semeval2015.d000.s023.t004 Dataset: semeval2015 Bucket: Candidate Count / 11+

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: block
Target surface form: blocks
Context:
Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is converted into an active form that <t>blocks</t> the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied?

Candidate senses:
1. sense_key=block%2:35:00:: | definition=render unsuitable for passage | synonyms=barricade, blockade, stop, block off, block up, bar | examples=block the way; barricade the streets
2. sense_key=block%2:41:00:: | definition=hinder or prevent the progress or accomplishment of | synonyms=obstruct, blockade, hinder, stymie, stymy, embarrass | examples=His brother blocked him at every turn
3. sense_key=block%2:41:01:: | definition=stop from happening or developing | synonyms=stop, halt, kibosh | examples=Block his election; Halt the process
4. sense_key=block%2:32:00:: | definition=interfere with or prevent the reception of signals | synonyms=jam | examples=Jam the Voice of America; block the signals emitted by this station
5. sense_key=block%2:41:03:: | definition=run on a block system | examples=block trains
6. sense_key=block%2:39:05:: | definition=interrupt the normal function of by means of anesthesia | examples=block a nerve; block a muscle
7. sense_key=block%2:39:00:: | definition=shut out from view or get in the way so as to hide from sight | synonyms=obstruct | examples=The thick curtain blocked the action on the stage; The trees obstruct my view of the mountains
8. sense_key=block%2:35:03:: | definition=stamp or emboss a title or design on a book with a block | examples=block the book cover
9. sense_key=block%2:35:02:: | definition=obstruct | synonyms=stuff, lug, choke up | examples=My nose is all stuffed; Her arteries are blocked
10. sense_key=block%2:35:12:: | definition=block passage through | synonyms=obstruct, obturate, impede, occlude, jam, close up | examples=obstruct the path
11. sense_key=block%2:35:06:: | definition=support, secure, or raise with a block | examples=block a plate for printing; block the wheels of a car
12. sense_key=block%2:33:00:: | definition=impede the movement of (an opponent or a ball) | synonyms=parry, deflect | examples=block an attack
13. sense_key=block%2:31:00:: | definition=be unable to remember | synonyms=forget, blank out, draw a blank | examples=I'm drawing a blank; You are blocking the name of your first wife!
14. sense_key=block%2:30:01:: | definition=shape by using a block | examples=Block a hat; block a garment
15. sense_key=block%2:30:00:: | definition=shape into a block or blocks | examples=block the graphs so one can see the results clearly
16. sense_key=block%2:30:02:: | definition=prohibit the conversion or use of (assets) | synonyms=freeze, immobilize, immobilise | examples=Blocked funds; Freeze the assets of this hostile government

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    render unsuitable for passage

    block%2:35:00:: · barricade.v.01

    • block the way
    • barricade the streets

    Synonyms: barricade, blockade, stop, block off, block up, bar

  2. 2

    hinder or prevent the progress or accomplishment of

    block%2:41:00:: · obstruct.v.01

    • His brother blocked him at every turn

    Synonyms: obstruct, blockade, hinder, stymie, stymy, embarrass

    Selected
  3. 3

    stop from happening or developing

    block%2:41:01:: · stop.v.03

    • Block his election
    • Halt the process

    Synonyms: stop, halt, kibosh

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    interfere with or prevent the reception of signals

    block%2:32:00:: · jam.v.04

    • Jam the Voice of America
    • block the signals emitted by this station

    Synonyms: jam

  5. 5

    run on a block system

    block%2:41:03:: · block.v.05

    • block trains
  6. 6

    interrupt the normal function of by means of anesthesia

    block%2:39:05:: · block.v.06

    • block a nerve
    • block a muscle
  7. 7

    shut out from view or get in the way so as to hide from sight

    block%2:39:00:: · obstruct.v.03

    • The thick curtain blocked the action on the stage
    • The trees obstruct my view of the mountains

    Synonyms: obstruct

  8. 8

    stamp or emboss a title or design on a book with a block

    block%2:35:03:: · block.v.08

    • block the book cover
  9. 9

    obstruct

    block%2:35:02:: · stuff.v.03

    • My nose is all stuffed
    • Her arteries are blocked

    Synonyms: stuff, lug, choke up

  10. 10

    block passage through

    block%2:35:12:: · obstruct.v.02

    • obstruct the path

    Synonyms: obstruct, obturate, impede, occlude, jam, close up

  11. 11

    support, secure, or raise with a block

    block%2:35:06:: · block.v.11

    • block a plate for printing
    • block the wheels of a car
  12. 12

    impede the movement of (an opponent or a ball)

    block%2:33:00:: · parry.v.01

    • block an attack

    Synonyms: parry, deflect

  13. 13

    be unable to remember

    block%2:31:00:: · forget.v.02

    • I'm drawing a blank
    • You are blocking the name of your first wife!

    Synonyms: forget, blank out, draw a blank

  14. 14

    shape by using a block

    block%2:30:01:: · block.v.14

    • Block a hat
    • block a garment
  15. 15

    shape into a block or blocks

    block%2:30:00:: · block.v.15

    • block the graphs so one can see the results clearly
  16. 16

    prohibit the conversion or use of (assets)

    block%2:30:02:: · freeze.v.08

    • Blocked funds
    • Freeze the assets of this hostile government

    Synonyms: freeze, immobilize, immobilise

show Verb

Instance: semeval2015.d000.s030.t001 Dataset: semeval2015 Bucket: Candidate Count / 11+

Incorrect

For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before.

The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone.

For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

In all three studies, the main measure of effectiveness was how long the patients survived.

What benefit has Alimta shown during the studies?

Alimta increased the survival time of patients with malignant pleural mesothelioma.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: show
Target surface form: shown
Context:
For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before. The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone. For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past. Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past. In all three studies, the main measure of effectiveness was how long the patients survived. What benefit has Alimta <t>shown</t> during the studies? Alimta increased the survival time of patients with malignant pleural mesothelioma.

Candidate senses:
1. sense_key=show%2:39:02:: | definition=give an exhibition of to an interested audience | synonyms=demo, exhibit, present, demonstrate | examples=She shows her dogs frequently; We will demo the new software in Washington
2. sense_key=show%2:31:00:: | definition=establish the validity of something, as by an example, explanation or experiment | synonyms=prove, demonstrate, establish, shew | examples=The experiment demonstrated the instability of the compound; The mathematician showed the validity of the conjecture
3. sense_key=show%2:32:00:: | definition=provide evidence for | synonyms=testify, bear witness, prove, evidence | examples=The blood test showed that he was the father; Her behavior testified to her incompetence
4. sense_key=show%2:39:00:: | definition=make visible or noticeable | examples=She showed her talent for cooking; Show me your etchings, please
5. sense_key=show%2:36:00:: | definition=show in, or as in, a picture | synonyms=picture, depict, render | examples=This scene depicts country life; the face of the child is rendered with much tenderness in this painting
6. sense_key=show%2:32:02:: | definition=give expression to | synonyms=express, evince | examples=She showed her disappointment
7. sense_key=show%2:32:01:: | definition=indicate a place, direction, person, or thing; either spatially or figuratively | synonyms=indicate, point, designate | examples=I showed the customer the glove section; He pointed to the empty parking space
8. sense_key=show%2:39:01:: | definition=be or become visible or noticeable | synonyms=show up | examples=His good upbringing really shows; The dirty side will show
9. sense_key=show%2:32:04:: | definition=indicate a certain reading; of gauges and instruments | synonyms=read, register, record | examples=The thermometer showed thirteen degrees below zero; The gauge read `empty'
10. sense_key=show%2:32:03:: | definition=give evidence of, as of records | examples=The diary shows his distress that evening
11. sense_key=show%2:38:00:: | definition=take (someone) to their seats, as in theaters or auditoriums | synonyms=usher | examples=The usher showed us to our seats
12. sense_key=show%2:33:00:: | definition=finish third or better in a horse or dog race | examples=he bet $2 on number six to show

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    give an exhibition of to an interested audience

    show%2:39:02:: · show.v.01

    • She shows her dogs frequently
    • We will demo the new software in Washington

    Synonyms: demo, exhibit, present, demonstrate

  2. 2

    establish the validity of something, as by an example, explanation or experiment

    show%2:31:00:: · prove.v.02

    • The experiment demonstrated the instability of the compound
    • The mathematician showed the validity of the conjecture

    Synonyms: prove, demonstrate, establish, shew

    Gold Raganato Selected
  3. 3

    provide evidence for

    show%2:32:00:: · testify.v.02

    • The blood test showed that he was the father
    • Her behavior testified to her incompetence

    Synonyms: testify, bear witness, prove, evidence

    Gold lexEN Gold Maru 2022
  4. 4

    make visible or noticeable

    show%2:39:00:: · show.v.04

    • She showed her talent for cooking
    • Show me your etchings, please
    Gold lexEN Gold Maru 2022
  5. 5

    show in, or as in, a picture

    show%2:36:00:: · picture.v.02

    • This scene depicts country life
    • the face of the child is rendered with much tenderness in this painting

    Synonyms: picture, depict, render

    Gold Raganato
  6. 6

    give expression to

    show%2:32:02:: · express.v.01

    • She showed her disappointment

    Synonyms: express, evince

  7. 7

    indicate a place, direction, person, or thing; either spatially or figuratively

    show%2:32:01:: · indicate.v.02

    • I showed the customer the glove section
    • He pointed to the empty parking space

    Synonyms: indicate, point, designate

  8. 8

    be or become visible or noticeable

    show%2:39:01:: · show.v.08

    • His good upbringing really shows
    • The dirty side will show

    Synonyms: show up

  9. 9

    indicate a certain reading; of gauges and instruments

    show%2:32:04:: · read.v.08

    • The thermometer showed thirteen degrees below zero
    • The gauge read `empty'

    Synonyms: read, register, record

  10. 10

    give evidence of, as of records

    show%2:32:03:: · show.v.10

    • The diary shows his distress that evening
  11. 11

    take (someone) to their seats, as in theaters or auditoriums

    show%2:38:00:: · usher.v.01

    • The usher showed us to our seats

    Synonyms: usher

  12. 12

    finish third or better in a horse or dog race

    show%2:33:00:: · show.v.12

    • he bet $2 on number six to show

find Verb

Instance: semeval2015.d001.s008.t001 Dataset: semeval2015 Bucket: Candidate Count / 11+

Incorrect

kalgebra is a MathML based graph calculator.

Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge.

Here's a screenshot of kalgebra main window

kalgebra main window

kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab.

Below these tabs you will find an input field to type your functions or do your calculations.

If we want to understand how it works, the best thing we can do is to realize that our input is being converted into MathML although it is not necessary to know MathML.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: find
Target surface form: find
Context:
kalgebra is a MathML based graph calculator. Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge. Here's a screenshot of kalgebra main window kalgebra main window kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab. Below these tabs you will <t>find</t> an input field to type your functions or do your calculations. If we want to understand how it works, the best thing we can do is to realize that our input is being converted into MathML although it is not necessary to know MathML.

Candidate senses:
1. sense_key=find%2:40:02:: | definition=come upon, as if by accident; meet with | synonyms=happen, chance, bump, encounter | examples=We find this idea in Plato; I happened upon the most wonderful bakery not very far from here
2. sense_key=find%2:39:02:: | definition=discover or determine the existence, presence, or fact of | synonyms=detect, observe, discover, notice | examples=She detected high levels of lead in her drinking water; We found traces of lead in the paint
3. sense_key=find%2:40:00:: | definition=come upon after searching; find the location of something that was missed or lost | synonyms=regain | examples=Did you find your glasses?; I cannot find my gloves!
4. sense_key=find%2:32:00:: | definition=establish after a calculation, investigation, experiment, survey, or study | synonyms=determine, find out, ascertain | examples=find the product of two numbers; The physicist who found the elusive particle won the Nobel Prize
5. sense_key=find%2:31:10:: | definition=come to believe on the basis of emotion, intuitions, or indefinite grounds | synonyms=feel | examples=I feel that he doesn't like me; I find him to be obnoxious
6. sense_key=find%2:39:01:: | definition=perceive or be contemporaneous with | synonyms=witness, see | examples=We found Republicans winning the offices; You'll see a lot of cheating in this school
7. sense_key=find%2:40:01:: | definition=get something or somebody for a specific purpose | synonyms=line up, get hold, come up | examples=I found this gadget that will serve as a bottle opener; I got hold of these tools to fix our plumbing
8. sense_key=find%2:36:00:: | definition=make a discovery, make a new finding | synonyms=discover | examples=Roentgen discovered X-rays; Physicists believe they found a new elementary particle
9. sense_key=find%2:31:09:: | definition=make a discovery | synonyms=discover | examples=She found that he had lied to her; The story is false, so far as I can discover
10. sense_key=find%2:40:03:: | definition=obtain through effort or management | examples=She found the time and energy to take care of her aging parents; We found the money to send our sons to college
11. sense_key=find%2:32:01:: | definition=decide on and make a declaration about | synonyms=rule | examples=find someone guilty
12. sense_key=find%2:30:00:: | definition=receive a specified treatment (abstract) | synonyms=receive, get, obtain, incur | examples=These aspects of civilization do not find expression or receive an interpretation; His movie received a good review
13. sense_key=find%2:39:05:: | definition=perceive oneself to be in a certain condition or place | examples=I found myself in a difficult situation; When he woke up, he found himself in a hospital room
14. sense_key=find%2:40:15:: | definition=get or find back; recover the use of | synonyms=recover, retrieve, regain | examples=She regained control of herself; She found her voice and replied quickly
15. sense_key=find%2:38:10:: | definition=succeed in reaching; arrive at | examples=The arrow found its mark
16. sense_key=find%2:30:13:: | definition=accept and make use of one's personality, abilities, and situation | synonyms=find oneself | examples=My son went to Berkeley to find himself

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    come upon, as if by accident; meet with

    find%2:40:02:: · find.v.01

    • We find this idea in Plato
    • I happened upon the most wonderful bakery not very far from here

    Synonyms: happen, chance, bump, encounter

    Selected
  2. 2

    discover or determine the existence, presence, or fact of

    find%2:39:02:: · detect.v.01

    • She detected high levels of lead in her drinking water
    • We found traces of lead in the paint

    Synonyms: detect, observe, discover, notice

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    come upon after searching; find the location of something that was missed or lost

    find%2:40:00:: · find.v.03

    • Did you find your glasses?
    • I cannot find my gloves!

    Synonyms: regain

  4. 4

    establish after a calculation, investigation, experiment, survey, or study

    find%2:32:00:: · determine.v.01

    • find the product of two numbers
    • The physicist who found the elusive particle won the Nobel Prize

    Synonyms: determine, find out, ascertain

  5. 5

    come to believe on the basis of emotion, intuitions, or indefinite grounds

    find%2:31:10:: · find.v.05

    • I feel that he doesn't like me
    • I find him to be obnoxious

    Synonyms: feel

  6. 6

    perceive or be contemporaneous with

    find%2:39:01:: · witness.v.02

    • We found Republicans winning the offices
    • You'll see a lot of cheating in this school

    Synonyms: witness, see

  7. 7

    get something or somebody for a specific purpose

    find%2:40:01:: · line_up.v.02

    • I found this gadget that will serve as a bottle opener
    • I got hold of these tools to fix our plumbing

    Synonyms: line up, get hold, come up

  8. 8

    make a discovery, make a new finding

    find%2:36:00:: · discover.v.03

    • Roentgen discovered X-rays
    • Physicists believe they found a new elementary particle

    Synonyms: discover

  9. 9

    make a discovery

    find%2:31:09:: · discover.v.04

    • She found that he had lied to her
    • The story is false, so far as I can discover

    Synonyms: discover

  10. 10

    obtain through effort or management

    find%2:40:03:: · find.v.10

    • She found the time and energy to take care of her aging parents
    • We found the money to send our sons to college
  11. 11

    decide on and make a declaration about

    find%2:32:01:: · rule.v.04

    • find someone guilty

    Synonyms: rule

  12. 12

    receive a specified treatment (abstract)

    find%2:30:00:: · receive.v.02

    • These aspects of civilization do not find expression or receive an interpretation
    • His movie received a good review

    Synonyms: receive, get, obtain, incur

  13. 13

    perceive oneself to be in a certain condition or place

    find%2:39:05:: · find.v.13

    • I found myself in a difficult situation
    • When he woke up, he found himself in a hospital room
  14. 14

    get or find back; recover the use of

    find%2:40:15:: · recover.v.01

    • She regained control of herself
    • She found her voice and replied quickly

    Synonyms: recover, retrieve, regain

  15. 15

    succeed in reaching; arrive at

    find%2:38:10:: · find.v.15

    • The arrow found its mark
  16. 16

    accept and make use of one's personality, abilities, and situation

    find%2:30:13:: · find_oneself.v.01

    • My son went to Berkeley to find himself

    Synonyms: find oneself