Verified run

claude-haiku-5-5

claude-haiku-5.5-none-reasoning-p004-lexen-v1-20261009

Rank
208
Accuracy lexEN v1 · WordNet fine
83.75%
Correct
4071 / 4861
Actual run cost
$0.472
Cost / M items
$97.11

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 83.75% 4071 / 4861 93.05% 4523 / 4861 89.49% 4350 / 4861
Maru 2022 (ALLamended) 81.61% 3967 / 4861 92.22% 4483 / 4861 88.15% 4285 / 4861
Raganato 2017 (original) 77.25% 3755 / 4861 90.43% 4396 / 4861 85.31% 4147 / 4861

Model

Display
claude-haiku-5-5
Requested
claude-haiku-5-5
Resolved
claude-haiku-5-5
Vendor
Anthropic
API provider
Anthropic
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
none
Model URL
n/a
Endpoint
n/a
Resolved counts
claude-haiku-5-5: 4862

Reproducibility

Created
2026-10-09T12:42:38.421130+00:00
Run schema
sensebench-run-v2
Commit
9040664a78ce4afacbe5400eaf6538ee664f3dea
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p004
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4862
Total tokens
4,475,061
Tokens / item
920.6
Total cost
$0.472
Cost / M items
$97.11
Cost source
litellm_estimate
Elapsed
2.42m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
32,768
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.472. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 4,413,683 $0.441 $0.100
Input cached 0 $0.00 $0.0100
Output 61,378 $0.0307 $0.500
Reasoning output 0 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 67.76% 538 794
Candidate Count 2 93.68% 801 855
Candidate Count 3-5 86.99% 1692 1945
Candidate Count 6-10 82.08% 1040 1267
POS ADJ 87.86% 579 659
POS ADV 81.03% 158 195
POS NOUN 86.85% 2516 2897
POS VERB 73.69% 818 1110
Source Dataset semeval2013 88.07% 1004 1140
Source Dataset semeval2015 85.12% 629 739
Source Dataset senseval2 81.65% 1330 1629
Source Dataset senseval3 81.89% 1108 1353

Worst-Bucket Examples

point Noun

Instance: semeval2013.d001.s008.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph.

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: point
Target surface form: points
Context:
Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph. The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 <t>points</t>, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Candidate senses:
1. sense_key=point%1:15:00:: | definition=the precise location of something; a spatially limited location | examples=she walked to a point where she could survey the whole street
2. sense_key=point%1:10:00:: | definition=a punctuation mark (.) placed at the end of a declarative sentence to indicate a full stop or after abbreviations | synonyms=period, full stop, stop, full point | examples=in England they call a period a stop
3. sense_key=point%1:06:01:: | definition=a wall socket | synonyms=power point
4. sense_key=point%1:25:02:: | definition=a very small circular shape | synonyms=dot | examples=a row of points; draw lines between the dots
5. sense_key=point%1:10:01:: | definition=a brief version of the essential meaning of something | examples=get to the point; he missed the point of the joke
6. sense_key=point%1:28:00:: | definition=an instant of time | synonyms=point in time | examples=at that point I had to leave
7. sense_key=point%1:09:02:: | definition=the object of an activity | examples=what is the point of discussing it?
8. sense_key=point%1:07:00:: | definition=the property of a shape that tapers to a sharp tip | synonyms=pointedness
9. sense_key=point%1:09:00:: | definition=a geometric element that has position but no extension | examples=a point is defined by its coordinates
10. sense_key=point%1:10:02:: | definition=a V-shaped mark at one end of an arrow pointer | synonyms=head | examples=the point of the arrow was due north
11. sense_key=point%1:07:02:: | definition=a distinguishing or individuating characteristic | examples=he knows my bad points as well as my good points
12. sense_key=point%1:07:01:: | definition=an outstanding characteristic | synonyms=spot | examples=his acting was one of the high points of the movie
13. sense_key=point%1:09:01:: | definition=an isolated fact that is considered separately from the whole | synonyms=detail, item | examples=several of the details are similar; a point of information
14. sense_key=point%1:23:00:: | definition=a linear unit used to measure the size of type; approximately 1/72 inch
15. sense_key=point%1:06:02:: | definition=the gun muzzle's direction | synonyms=gunpoint | examples=he held me up at the point of a gun
16. sense_key=point%1:06:00:: | definition=sharp end | examples=he stuck the point of the knife into a tree; he broke the point of his pencil
17. sense_key=point%1:23:01:: | definition=the unit of counting in scoring a game or contest | examples=he scored 20 points in the first half; a touchdown counts 6 points
18. sense_key=point%1:21:00:: | definition=one percent of the total principal of a loan; it is paid at the time the loan is made and is independent of the interest on the loan
19. sense_key=point%1:24:00:: | definition=any of 32 horizontal directions indicated on the card of a compass | synonyms=compass point | examples=he checked the point on his compass
20. sense_key=point%1:25:00:: | definition=a V shape | synonyms=tip, peak | examples=the cannibal's teeth were filed to sharp points
21. sense_key=point%1:24:04:: | definition=a style in speech or writing that arrests attention and has a penetrating or convincing quality or effect
22. sense_key=point%1:06:03:: | definition=a contact in the distributor; as the rotor turns its projecting arm contacts them and current flows to the spark plugs | synonyms=distributor point, breaker point
23. sense_key=point%1:26:00:: | definition=a specific identifiable position in a continuum or series or especially in a process | synonyms=degree, level, stage | examples=a remarkable degree of frankness; at what stage are the social sciences?
24. sense_key=point%1:10:04:: | definition=the dot at the left of a decimal fraction | synonyms=decimal point, percentage point
25. sense_key=point%1:17:02:: | definition=a promontory extending out into a large body of water | examples=they sailed south around the point
26. sense_key=point%1:10:03:: | definition=a distinct part that can be specified separately in a group of things that could be enumerated on a list | synonyms=item | examples=he noticed an item in the New York Times; she had several items on her shopping list

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the precise location of something; a spatially limited location

    point%1:15:00:: · point.n.02

    • she walked to a point where she could survey the whole street
  2. 2

    a punctuation mark (.) placed at the end of a declarative sentence to indicate a full stop or after abbreviations

    point%1:10:00:: · period.n.07

    • in England they call a period a stop

    Synonyms: period, full stop, stop, full point

  3. 3

    a wall socket

    point%1:06:01:: · point.n.25

    Synonyms: power point

  4. 4

    a very small circular shape

    point%1:25:02:: · point.n.09

    • a row of points
    • draw lines between the dots

    Synonyms: dot

  5. 5

    a brief version of the essential meaning of something

    point%1:10:01:: · point.n.03

    • get to the point
    • he missed the point of the joke
  6. 6

    an instant of time

    point%1:28:00:: · point.n.06

    • at that point I had to leave

    Synonyms: point in time

  7. 7

    the object of an activity

    point%1:09:02:: · point.n.07

    • what is the point of discussing it?
  8. 8

    the property of a shape that tapers to a sharp tip

    point%1:07:00:: · point.n.22

    Synonyms: pointedness

  9. 9

    a geometric element that has position but no extension

    point%1:09:00:: · point.n.01

    • a point is defined by its coordinates
  10. 10

    a V-shaped mark at one end of an arrow pointer

    point%1:10:02:: · point.n.20

    • the point of the arrow was due north

    Synonyms: head

  11. 11

    a distinguishing or individuating characteristic

    point%1:07:02:: · point.n.23

    • he knows my bad points as well as my good points
  12. 12

    an outstanding characteristic

    point%1:07:01:: · point.n.14

    • his acting was one of the high points of the movie

    Synonyms: spot

  13. 13

    an isolated fact that is considered separately from the whole

    point%1:09:01:: · detail.n.01

    • several of the details are similar
    • a point of information

    Synonyms: detail, item

  14. 14

    a linear unit used to measure the size of type; approximately 1/72 inch

    point%1:23:00:: · point.n.17

  15. 15

    the gun muzzle's direction

    point%1:06:02:: · point.n.24

    • he held me up at the point of a gun

    Synonyms: gunpoint

  16. 16

    sharp end

    point%1:06:00:: · point.n.15

    • he stuck the point of the knife into a tree
    • he broke the point of his pencil
  17. 17

    the unit of counting in scoring a game or contest

    point%1:23:01:: · point.n.10

    • he scored 20 points in the first half
    • a touchdown counts 6 points
    Gold lexEN Gold Maru 2022 Gold Raganato
  18. 18

    one percent of the total principal of a loan; it is paid at the time the loan is made and is independent of the interest on the loan

    point%1:21:00:: · point.n.18

  19. 19

    any of 32 horizontal directions indicated on the card of a compass

    point%1:24:00:: · compass_point.n.01

    • he checked the point on his compass

    Synonyms: compass point

  20. 20

    a V shape

    point%1:25:00:: · point.n.08

    • the cannibal's teeth were filed to sharp points

    Synonyms: tip, peak

  21. 21

    a style in speech or writing that arrests attention and has a penetrating or convincing quality or effect

    point%1:24:04:: · point.n.13

  22. 22

    a contact in the distributor; as the rotor turns its projecting arm contacts them and current flows to the spark plugs

    point%1:06:03:: · distributor_point.n.01

    Synonyms: distributor point, breaker point

  23. 23

    a specific identifiable position in a continuum or series or especially in a process

    point%1:26:00:: · degree.n.02

    • a remarkable degree of frankness
    • at what stage are the social sciences?

    Synonyms: degree, level, stage

    Selected
  24. 24

    the dot at the left of a decimal fraction

    point%1:10:04:: · decimal_point.n.01

    Synonyms: decimal point, percentage point

  25. 25

    a promontory extending out into a large body of water

    point%1:17:02:: · point.n.11

    • they sailed south around the point
  26. 26

    a distinct part that can be specified separately in a group of things that could be enumerated on a list

    point%1:10:03:: · item.n.01

    • he noticed an item in the New York Times
    • she had several items on her shopping list

    Synonyms: item

play Noun

Instance: semeval2013.d001.s012.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: play
Target surface form: plays
Context:
The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game. Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of <t>plays</t> correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

Candidate senses:
1. sense_key=play%1:04:00:: | definition=gay or light-hearted recreational activity for diversion or amusement | synonyms=frolic, romp, gambol, caper | examples=it was all done in play; their frolic in the surf threatened to become ugly
2. sense_key=play%1:26:01:: | definition=the removal of constraints | synonyms=free rein | examples=he gave free rein to his impulses; they gave full play to the artist's talent
3. sense_key=play%1:10:02:: | definition=verbal wit or mockery (often at another's expense but not to be taken seriously) | synonyms=fun, sport | examples=he became a figure of fun; he said it in sport
4. sense_key=play%1:04:07:: | definition=the act using a sword (or other weapon) vigorously and skillfully | synonyms=swordplay
5. sense_key=play%1:04:04:: | definition=a deliberate coordinated movement requiring dexterity and skill | synonyms=maneuver, manoeuvre | examples=he made a great maneuver; the runner was out on a play by the shortstop
6. sense_key=play%1:10:01:: | definition=a dramatic work intended for performance by actors on a stage | synonyms=drama, dramatic play | examples=he wrote several plays but only one was produced on Broadway
7. sense_key=play%1:04:05:: | definition=a preset plan of action in team sports | examples=the coach drew up the plays for her team
8. sense_key=play%1:04:08:: | definition=utilization or exercise | examples=the play of the imagination
9. sense_key=play%1:07:00:: | definition=movement or space for movement | synonyms=looseness | examples=there was too much play in the steering wheel
10. sense_key=play%1:28:00:: | definition=(in games or plays or other performances) the time during which play proceeds | synonyms=playing period, period of play | examples=rain stopped play in the 4th inning
11. sense_key=play%1:04:01:: | definition=(game) the activity of doing something in an agreed succession | synonyms=turn | examples=it is my turn; it is still my play
12. sense_key=play%1:04:02:: | definition=the act of playing for stakes in the hope of winning (including the payment of a price for a chance to win a prize) | synonyms=gambling, gaming | examples=his gambling cost him a fortune; there was heavy play at the blackjack table
13. sense_key=play%1:26:00:: | definition=a state in which action is feasible | examples=the ball was still in play; insiders said the company's stock was in play
14. sense_key=play%1:10:03:: | definition=a theatrical performance of a drama | examples=the play lasted two hours
15. sense_key=play%1:04:06:: | definition=activity by children that is guided more by imagination than by fixed rules | synonyms=child's play | examples=Freud believed in the utility of play to a small child
16. sense_key=play%1:11:00:: | definition=a weak and tremulous light | synonyms=shimmer | examples=the shimmer of colors on iridescent feathers; the play of light on the water
17. sense_key=play%1:04:03:: | definition=an attempt to get something | synonyms=bid | examples=they made a futile play for power; he made a bid to gain attention

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    gay or light-hearted recreational activity for diversion or amusement

    play%1:04:00:: · play.n.14

    • it was all done in play
    • their frolic in the surf threatened to become ugly

    Synonyms: frolic, romp, gambol, caper

  2. 2

    the removal of constraints

    play%1:26:01:: · free_rein.n.01

    • he gave free rein to his impulses
    • they gave full play to the artist's talent

    Synonyms: free rein

  3. 3

    verbal wit or mockery (often at another's expense but not to be taken seriously)

    play%1:10:02:: · fun.n.02

    • he became a figure of fun
    • he said it in sport

    Synonyms: fun, sport

  4. 4

    the act using a sword (or other weapon) vigorously and skillfully

    play%1:04:07:: · play.n.17

    Synonyms: swordplay

  5. 5

    a deliberate coordinated movement requiring dexterity and skill

    play%1:04:04:: · maneuver.n.03

    • he made a great maneuver
    • the runner was out on a play by the shortstop

    Synonyms: maneuver, manoeuvre

    Selected
  6. 6

    a dramatic work intended for performance by actors on a stage

    play%1:10:01:: · play.n.01

    • he wrote several plays but only one was produced on Broadway

    Synonyms: drama, dramatic play

  7. 7

    a preset plan of action in team sports

    play%1:04:05:: · play.n.03

    • the coach drew up the plays for her team
    Gold lexEN Gold Maru 2022 Gold Raganato
  8. 8

    utilization or exercise

    play%1:04:08:: · play.n.06

    • the play of the imagination
  9. 9

    movement or space for movement

    play%1:07:00:: · looseness.n.05

    • there was too much play in the steering wheel

    Synonyms: looseness

  10. 10

    (in games or plays or other performances) the time during which play proceeds

    play%1:28:00:: · playing_period.n.01

    • rain stopped play in the 4th inning

    Synonyms: playing period, period of play

  11. 11

    (game) the activity of doing something in an agreed succession

    play%1:04:01:: · turn.n.03

    • it is my turn
    • it is still my play

    Synonyms: turn

  12. 12

    the act of playing for stakes in the hope of winning (including the payment of a price for a chance to win a prize)

    play%1:04:02:: · gambling.n.01

    • his gambling cost him a fortune
    • there was heavy play at the blackjack table

    Synonyms: gambling, gaming

  13. 13

    a state in which action is feasible

    play%1:26:00:: · play.n.05

    • the ball was still in play
    • insiders said the company's stock was in play
  14. 14

    a theatrical performance of a drama

    play%1:10:03:: · play.n.02

    • the play lasted two hours
  15. 15

    activity by children that is guided more by imagination than by fixed rules

    play%1:04:06:: · play.n.08

    • Freud believed in the utility of play to a small child

    Synonyms: child's play

  16. 16

    a weak and tremulous light

    play%1:11:00:: · shimmer.n.01

    • the shimmer of colors on iridescent feathers
    • the play of light on the water

    Synonyms: shimmer

  17. 17

    an attempt to get something

    play%1:04:03:: · bid.n.02

    • they made a futile play for power
    • he made a bid to gain attention

    Synonyms: bid

lead Noun

Instance: semeval2013.d001.s012.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: lead
Target surface form: lead
Context:
The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game. Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring <t>lead</t> (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

Candidate senses:
1. sense_key=lead%1:07:01:: | definition=the timing of ignition relative to the position of the piston in an internal-combustion engine | synonyms=spark advance
2. sense_key=lead%1:04:01:: | definition=a position of leadership (especially in the phrase `take the lead') | examples=he takes the lead in any group; we were just waiting for someone to take the lead
3. sense_key=lead%1:07:02:: | definition=an advantage held by a competitor in a race | examples=he took the lead at the last turn
4. sense_key=lead%1:06:01:: | definition=a jumper that consists of a short piece of wire | synonyms=jumper cable, jumper lead, booster cable | examples=it was a tangle of jumper cables and clip leads
5. sense_key=lead%1:06:00:: | definition=mixture of graphite with clay in different degrees of hardness; the marking substance in a pencil | synonyms=pencil lead
6. sense_key=lead%1:15:00:: | definition=(baseball) the position taken by a base runner preparing to advance to the next base | examples=he took a long lead off first
7. sense_key=lead%1:23:00:: | definition=(sports) the score by which a team or individual is winning
8. sense_key=lead%1:27:00:: | definition=a soft heavy toxic malleable metallic element; bluish white when freshly cut but tarnishes readily to dull grey | synonyms=Pb, atomic number 82 | examples=the children were playing with lead soldiers
9. sense_key=lead%1:10:01:: | definition=the introductory section of a story | synonyms=lead-in, lede | examples=it was an amusing lead-in to a very serious matter
10. sense_key=lead%1:10:00:: | definition=a news story of major importance | synonyms=lead story
11. sense_key=lead%1:04:00:: | definition=the playing of a card to start a trick in bridge | examples=the lead was in the dummy
12. sense_key=lead%1:06:03:: | definition=restraint consisting of a rope (or light chain) used to restrain an animal | synonyms=leash, tether
13. sense_key=lead%1:25:00:: | definition=the angle between the direction a gun is aimed and the position of a moving target (correcting for the flight time of the missile)
14. sense_key=lead%1:10:02:: | definition=an indication of potential opportunity | synonyms=tip, steer, confidential information, wind, hint | examples=he got a tip on the stock market; a good lead for a job
15. sense_key=lead%1:06:02:: | definition=thin strip of metal used to separate lines of type in printing | synonyms=leading
16. sense_key=lead%1:18:00:: | definition=an actor who plays a principal role | synonyms=star, principal
17. sense_key=lead%1:09:00:: | definition=evidence pointing to a possible solution | synonyms=track, trail | examples=the police are following a promising lead; the trail led straight to the perpetrator

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    the timing of ignition relative to the position of the piston in an internal-combustion engine

    lead%1:07:01:: · spark_advance.n.01

    Synonyms: spark advance

  2. 2

    a position of leadership (especially in the phrase `take the lead')

    lead%1:04:01:: · lead.n.04

    • he takes the lead in any group
    • we were just waiting for someone to take the lead
  3. 3

    an advantage held by a competitor in a race

    lead%1:07:02:: · lead.n.01

    • he took the lead at the last turn
    Gold Raganato Selected
  4. 4

    a jumper that consists of a short piece of wire

    lead%1:06:01:: · jumper_cable.n.01

    • it was a tangle of jumper cables and clip leads

    Synonyms: jumper cable, jumper lead, booster cable

  5. 5

    mixture of graphite with clay in different degrees of hardness; the marking substance in a pencil

    lead%1:06:00:: · lead.n.15

    Synonyms: pencil lead

  6. 6

    (baseball) the position taken by a base runner preparing to advance to the next base

    lead%1:15:00:: · lead.n.09

    • he took a long lead off first
  7. 7

    (sports) the score by which a team or individual is winning

    lead%1:23:00:: · lead.n.07

    Gold lexEN Gold Maru 2022
  8. 8

    a soft heavy toxic malleable metallic element; bluish white when freshly cut but tarnishes readily to dull grey

    lead%1:27:00:: · lead.n.02

    • the children were playing with lead soldiers

    Synonyms: Pb, atomic number 82

  9. 9

    the introductory section of a story

    lead%1:10:01:: · lead.n.06

    • it was an amusing lead-in to a very serious matter

    Synonyms: lead-in, lede

  10. 10

    a news story of major importance

    lead%1:10:00:: · lead.n.11

    Synonyms: lead story

  11. 11

    the playing of a card to start a trick in bridge

    lead%1:04:00:: · lead.n.17

    • the lead was in the dummy
  12. 12

    restraint consisting of a rope (or light chain) used to restrain an animal

    lead%1:06:03:: · leash.n.01

    Synonyms: leash, tether

  13. 13

    the angle between the direction a gun is aimed and the position of a moving target (correcting for the flight time of the missile)

    lead%1:25:00:: · lead.n.05

  14. 14

    an indication of potential opportunity

    lead%1:10:02:: · tip.n.03

    • he got a tip on the stock market
    • a good lead for a job

    Synonyms: tip, steer, confidential information, wind, hint

  15. 15

    thin strip of metal used to separate lines of type in printing

    lead%1:06:02:: · lead.n.14

    Synonyms: leading

  16. 16

    an actor who plays a principal role

    lead%1:18:00:: · star.n.04

    Synonyms: star, principal

  17. 17

    evidence pointing to a possible solution

    lead%1:09:00:: · lead.n.03

    • the police are following a promising lead
    • the trail led straight to the perpetrator

    Synonyms: track, trail

line Noun

Instance: semeval2013.d001.s014.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77).

In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: line
Target surface form: line
Context:
But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game. Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes. However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point <t>line</t> (70-77). In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Candidate senses:
1. sense_key=line%1:15:01:: | definition=in games or sports; a mark indicating positions or bounds of the playing area
2. sense_key=line%1:06:00:: | definition=something (as a cord or rope) that is long and thin and flexible | examples=a washing line
3. sense_key=line%1:04:01:: | definition=acting in conformity | examples=in line with; he got out of line
4. sense_key=line%1:15:00:: | definition=a spatial location defined by a real or imaginary unidimensional extent
5. sense_key=line%1:06:07:: | definition=a telephone connection | synonyms=telephone line, phone line, telephone circuit, subscriber line
6. sense_key=line%1:06:01:: | definition=a conductor for transmitting electrical or optical signals or electric power | synonyms=cable, transmission line
7. sense_key=line%1:10:02:: | definition=text consisting of a row of words written across a page or computer screen | examples=the letter consisted of three short lines; there are six lines in every stanza
8. sense_key=line%1:23:00:: | definition=space for one line of print (one column wide and 1/14 inch deep) used to measure advertising | synonyms=agate line
9. sense_key=line%1:10:01:: | definition=a mark that is long relative to its width | examples=He drew a line on the chart
10. sense_key=line%1:04:00:: | definition=the principal activity in your life that you do to earn money | synonyms=occupation, business, job, line of work | examples=he's not in my line of business
11. sense_key=line%1:10:05:: | definition=(often plural) a means of communication or access | synonyms=channel, communication channel | examples=it must go through official channels; lines of communication were set up between the two firms
12. sense_key=line%1:09:01:: | definition=a course of reasoning aimed at demonstrating a truth or falsehood; the methodical process of logical reasoning | synonyms=argumentation, logical argument, argument, line of reasoning | examples=I can't follow your line of reasoning
13. sense_key=line%1:21:00:: | definition=the maximum credit that a customer is allowed | synonyms=credit line, line of credit, bank line, personal credit line, personal line of credit
14. sense_key=line%1:06:05:: | definition=a commercial organization serving as a common carrier
15. sense_key=line%1:06:03:: | definition=the road consisting of railroad track and roadbed | synonyms=railway line, rail line
16. sense_key=line%1:25:01:: | definition=a slight depression in the smoothness of a surface | synonyms=wrinkle, furrow, crease, crinkle, seam | examples=his face has many lines; ironing gets rid of most wrinkles
17. sense_key=line%1:19:00:: | definition=a single frequency (or very narrow band) of radiation in a spectrum
18. sense_key=line%1:10:04:: | definition=a short personal letter | synonyms=note, short letter, billet | examples=drop me a line when you get there
19. sense_key=line%1:09:00:: | definition=a conceptual separation or distinction | synonyms=dividing line, demarcation, contrast | examples=there is a narrow line between sanity and insanity
20. sense_key=line%1:14:00:: | definition=the descendants of one individual | synonyms=lineage, line of descent, descent, bloodline, blood, pedigree | examples=his entire lineage has been warriors
21. sense_key=line%1:06:08:: | definition=a particular kind of product or merchandise | synonyms=product line, line of products, line of merchandise, business line, line of business | examples=a nice line of shoes
22. sense_key=line%1:14:02:: | definition=a connected series of events or actions or developments | synonyms=course | examples=the government took a firm course; historians can only point out those lines for which evidence is available
23. sense_key=line%1:10:03:: | definition=a succession of notes forming a distinctive sequence | synonyms=tune, melody, air, strain, melodic line, melodic phrase | examples=she was humming an air from Beethoven
24. sense_key=line%1:06:06:: | definition=a pipe used to transport liquids or gases | synonyms=pipeline | examples=a pipeline runs from the wells to the seaport
25. sense_key=line%1:14:01:: | definition=a formation of people or things one behind another | examples=the line stretched clear around the corner; you must wait in a long line at the checkout counter
26. sense_key=line%1:25:00:: | definition=a length (straight or curved) without breadth or thickness; the trace of a moving point
27. sense_key=line%1:14:03:: | definition=a formation of people or things one beside another | examples=the line of soldiers advanced with their bayonets fixed; they were arrayed in line of battle
28. sense_key=line%1:10:06:: | definition=persuasive but insincere talk that is usually intended to deceive or impress | examples=`let me show you my etchings' is a rather worn line; he has a smooth line but I didn't fall for it
29. sense_key=line%1:06:09:: | definition=mechanical system in a factory whereby an article is conveyed through sites at which successive operations are performed on it | synonyms=production line, assembly line
30. sense_key=line%1:15:02:: | definition=a fortified position (especially one marking the most forward position of troops) | examples=they attacked the enemy's line

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    in games or sports; a mark indicating positions or bounds of the playing area

    line%1:15:01:: · line.n.20

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    something (as a cord or rope) that is long and thin and flexible

    line%1:06:00:: · line.n.18

    • a washing line
  3. 3

    acting in conformity

    line%1:04:01:: · line.n.16

    • in line with
    • he got out of line
  4. 4

    a spatial location defined by a real or imaginary unidimensional extent

    line%1:15:00:: · line.n.11

  5. 5

    a telephone connection

    line%1:06:07:: · telephone_line.n.02

    Synonyms: telephone line, phone line, telephone circuit, subscriber line

  6. 6

    a conductor for transmitting electrical or optical signals or electric power

    line%1:06:01:: · cable.n.02

    Synonyms: cable, transmission line

  7. 7

    text consisting of a row of words written across a page or computer screen

    line%1:10:02:: · line.n.05

    • the letter consisted of three short lines
    • there are six lines in every stanza
  8. 8

    space for one line of print (one column wide and 1/14 inch deep) used to measure advertising

    line%1:23:00:: · agate_line.n.01

    Synonyms: agate line

  9. 9

    a mark that is long relative to its width

    line%1:10:01:: · line.n.02

    • He drew a line on the chart
    Selected
  10. 10

    the principal activity in your life that you do to earn money

    line%1:04:00:: · occupation.n.01

    • he's not in my line of business

    Synonyms: occupation, business, job, line of work

  11. 11

    (often plural) a means of communication or access

    line%1:10:05:: · channel.n.05

    • it must go through official channels
    • lines of communication were set up between the two firms

    Synonyms: channel, communication channel

  12. 12

    a course of reasoning aimed at demonstrating a truth or falsehood; the methodical process of logical reasoning

    line%1:09:01:: · argumentation.n.02

    • I can't follow your line of reasoning

    Synonyms: argumentation, logical argument, argument, line of reasoning

  13. 13

    the maximum credit that a customer is allowed

    line%1:21:00:: · credit_line.n.01

    Synonyms: credit line, line of credit, bank line, personal credit line, personal line of credit

  14. 14

    a commercial organization serving as a common carrier

    line%1:06:05:: · line.n.23

  15. 15

    the road consisting of railroad track and roadbed

    line%1:06:03:: · line.n.14

    Synonyms: railway line, rail line

  16. 16

    a slight depression in the smoothness of a surface

    line%1:25:01:: · wrinkle.n.01

    • his face has many lines
    • ironing gets rid of most wrinkles

    Synonyms: wrinkle, furrow, crease, crinkle, seam

  17. 17

    a single frequency (or very narrow band) of radiation in a spectrum

    line%1:19:00:: · line.n.06

  18. 18

    a short personal letter

    line%1:10:04:: · note.n.02

    • drop me a line when you get there

    Synonyms: note, short letter, billet

  19. 19

    a conceptual separation or distinction

    line%1:09:00:: · line.n.29

    • there is a narrow line between sanity and insanity

    Synonyms: dividing line, demarcation, contrast

  20. 20

    the descendants of one individual

    line%1:14:00:: · lineage.n.01

    • his entire lineage has been warriors

    Synonyms: lineage, line of descent, descent, bloodline, blood, pedigree, ancestry, origin, parentage, stemma, stock

  21. 21

    a particular kind of product or merchandise

    line%1:06:08:: · line.n.22

    • a nice line of shoes

    Synonyms: product line, line of products, line of merchandise, business line, line of business

  22. 22

    a connected series of events or actions or developments

    line%1:14:02:: · course.n.02

    • the government took a firm course
    • historians can only point out those lines for which evidence is available

    Synonyms: course

  23. 23

    a succession of notes forming a distinctive sequence

    line%1:10:03:: · tune.n.01

    • she was humming an air from Beethoven

    Synonyms: tune, melody, air, strain, melodic line, melodic phrase

  24. 24

    a pipe used to transport liquids or gases

    line%1:06:06:: · pipeline.n.02

    • a pipeline runs from the wells to the seaport

    Synonyms: pipeline

  25. 25

    a formation of people or things one behind another

    line%1:14:01:: · line.n.03

    • the line stretched clear around the corner
    • you must wait in a long line at the checkout counter
  26. 26

    a length (straight or curved) without breadth or thickness; the trace of a moving point

    line%1:25:00:: · line.n.04

  27. 27

    a formation of people or things one beside another

    line%1:14:03:: · line.n.01

    • the line of soldiers advanced with their bayonets fixed
    • they were arrayed in line of battle
  28. 28

    persuasive but insincere talk that is usually intended to deceive or impress

    line%1:10:06:: · line.n.27

    • `let me show you my etchings' is a rather worn line
    • he has a smooth line but I didn't fall for it
  29. 29

    mechanical system in a factory whereby an article is conveyed through sites at which successive operations are performed on it

    line%1:06:09:: · production_line.n.01

    Synonyms: production line, assembly line

  30. 30

    a fortified position (especially one marking the most forward position of troops)

    line%1:15:02:: · line.n.07

    • they attacked the enemy's line

figure Noun

Instance: semeval2013.d002.s002.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Wall Street closes without momentum, slowed by a strengthening dollar

The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%.

According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: figure
Target surface form: figures
Context:
Wall Street closes without momentum, slowed by a strengthening dollar The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%. According to final closing <t>figures</t>, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points. The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Candidate senses:
1. sense_key=figure%1:06:01:: | definition=a decorative or artistic work | synonyms=design, pattern | examples=the coach had a design on the doors
2. sense_key=figure%1:04:00:: | definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures
3. sense_key=figure%1:10:00:: | definition=a diagram or picture illustrating textual material | synonyms=fig | examples=the area covered can be seen from Figure 2
4. sense_key=figure%1:07:01:: | definition=the property possessed by a sum or total or indefinite quantity of units or individuals | synonyms=number | examples=he had a number of chores to do; the number of parameters is small
5. sense_key=figure%1:21:00:: | definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
6. sense_key=figure%1:08:00:: | definition=alternative names for the body of a human being | synonyms=human body, physical body, material body, soma, build, physique | examples=Leonardo studied the human body; he has a strong physique
7. sense_key=figure%1:18:00:: | definition=a well-known or notable person | synonyms=name, public figure | examples=they studied all the great names in the history of France; she is an important figure in modern music
8. sense_key=figure%1:10:01:: | definition=language used in a figurative or nonliteral sense | synonyms=trope, figure of speech, image
9. sense_key=figure%1:07:00:: | definition=the impression produced by a person | examples=he cut a fine figure; a heroic figure
10. sense_key=figure%1:23:00:: | definition=one of the elements that collectively form a system of numeration | synonyms=digit | examples=0 and 1 are digits
11. sense_key=figure%1:25:00:: | definition=a combination of points and lines and planes that form a visible palpable shape
12. sense_key=figure%1:06:00:: | definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
13. sense_key=figure%1:09:00:: | definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  2. 2

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures
  3. 3

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  4. 4

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  5. 5

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
    Selected
  6. 6

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  7. 7

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  8. 8

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  9. 9

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  10. 10

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  11. 11

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

  12. 12

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  13. 13

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

case Noun

Instance: semeval2013.d002.s005.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Wall Street closes without momentum, slowed by a strengthening dollar

The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%.

According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Frankly, the market is very calm, observes Mace Blicksilver of Marblehead Asset Management.

It remains within a narrow margin; trading volumes have become very weak, and I think that this will remain the case until the end of the year.

The trend was supported by the publication of better than expected economic indicators, which "have contributed to improving market opinion in relation to the robustness of the economic recovery", summarised Charles Schwab's analysts.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: case
Target surface form: case
Context:
Wall Street closes without momentum, slowed by a strengthening dollar The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%. According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points. The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points. Frankly, the market is very calm, observes Mace Blicksilver of Marblehead Asset Management. It remains within a narrow margin; trading volumes have become very weak, and I think that this will remain the <t>case</t> until the end of the year. The trend was supported by the publication of better than expected economic indicators, which "have contributed to improving market opinion in relation to the robustness of the economic recovery", summarised Charles Schwab's analysts.

Candidate senses:
1. sense_key=case%1:26:02:: | definition=a specific state of mind that is temporary | examples=a case of the jitters
2. sense_key=case%1:26:00:: | definition=a special set of circumstances | synonyms=event | examples=in that event, the first possibility is excluded; it may rain in which case the picnic will be canceled
3. sense_key=case%1:06:07:: | definition=the enclosing frame around a door or window opening | synonyms=casing | examples=the casings had rotted away and had to be replaced
4. sense_key=case%1:23:00:: | definition=the quantity contained in a case | synonyms=caseful
5. sense_key=case%1:06:00:: | definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. sense_key=case%1:06:01:: | definition=a glass container used to store and display items in a shop or museum or home | synonyms=display case, showcase, vitrine
7. sense_key=case%1:06:06:: | definition=the housing or outer covering of something | synonyms=shell, casing | examples=the clock has a walnut case
8. sense_key=case%1:04:00:: | definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | synonyms=lawsuit, suit, cause, causa | examples=the family brought suit against the landlord
9. sense_key=case%1:10:02:: | definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
10. sense_key=case%1:06:02:: | definition=bed linen consisting of a cover for a pillow | synonyms=pillowcase, slip, pillow slip | examples=the burglar carried his loot in a pillowcase
11. sense_key=case%1:10:01:: | definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
12. sense_key=case%1:18:04:: | definition=a person of a specified kind (usually with many eccentricities) | synonyms=character, eccentric, type | examples=a real character; a strange character
13. sense_key=case%1:11:00:: | definition=an occurrence of something | synonyms=instance, example | examples=it was a case of bad judgment; another instance occurred yesterday
14. sense_key=case%1:10:00:: | definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence | synonyms=grammatical case
15. sense_key=case%1:08:00:: | definition=an enveloping structure or covering enclosing an animal or plant organ or part | synonyms=sheath
16. sense_key=case%1:18:02:: | definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | synonyms=subject, guinea pig | examples=the subjects for this investigation were selected randomly; the cases that we studied were drawn from two different communities
17. sense_key=case%1:09:00:: | definition=the actual state of things | examples=that was not the case
18. sense_key=case%1:06:03:: | definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | synonyms=compositor's case, typesetter's case | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. sense_key=case%1:18:03:: | definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
20. sense_key=case%1:10:03:: | definition=a specific size and style of type within a type family | synonyms=font, fount, typeface, face

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
    Selected
  2. 2

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

  3. 3

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  4. 4

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  5. 5

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  6. 6

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine

  7. 7

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  8. 8

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

  9. 9

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
  10. 10

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  11. 11

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  12. 12

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  13. 13

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

  14. 14

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  15. 15

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  16. 16

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  17. 17

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
    Gold lexEN Gold Maru 2022 Gold Raganato
  18. 18

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  19. 19

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  20. 20

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

case Noun

Instance: semeval2013.d003.s011.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Two American companies reached deals for fields auctioned in June.

The meager representation of American oil giants in Iraq's opening oil industry surprised analysts.

Iraq finally opened its doors after six years of war, and instead of U.S. companies, you have Asians and Europeans leading the way, said Ruba Husari, the editor of Iraq Oil Forum, an online news outlet.

It will be a long time before anything else will be on offer in Iraq.

Concerns over security, underscored by massive coordinated bombings Tuesday, and political instability as the U.S. military withdraws, likely kept American oil companies from venturing more forcefully in Iraq, which has the world's third-largest proven crude reserves, analysts said.

U.S. firms were in some cases at a disadvantage because rivals, particularly the Chinese and other government controlled energy firms, have markedly lower labor costs and are more prone to take risks because they don't respond to shareholders.

Exxon-Mobil and Occidental Petroleum Inc. were the only American companies that reached deals with the ministry.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: case
Target surface form: cases
Context:
Two American companies reached deals for fields auctioned in June. The meager representation of American oil giants in Iraq's opening oil industry surprised analysts. Iraq finally opened its doors after six years of war, and instead of U.S. companies, you have Asians and Europeans leading the way, said Ruba Husari, the editor of Iraq Oil Forum, an online news outlet. It will be a long time before anything else will be on offer in Iraq. Concerns over security, underscored by massive coordinated bombings Tuesday, and political instability as the U.S. military withdraws, likely kept American oil companies from venturing more forcefully in Iraq, which has the world's third-largest proven crude reserves, analysts said. U.S. firms were in some <t>cases</t> at a disadvantage because rivals, particularly the Chinese and other government controlled energy firms, have markedly lower labor costs and are more prone to take risks because they don't respond to shareholders. Exxon-Mobil and Occidental Petroleum Inc. were the only American companies that reached deals with the ministry.

Candidate senses:
1. sense_key=case%1:18:03:: | definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
2. sense_key=case%1:04:00:: | definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | synonyms=lawsuit, suit, cause, causa | examples=the family brought suit against the landlord
3. sense_key=case%1:18:04:: | definition=a person of a specified kind (usually with many eccentricities) | synonyms=character, eccentric, type | examples=a real character; a strange character
4. sense_key=case%1:06:06:: | definition=the housing or outer covering of something | synonyms=shell, casing | examples=the clock has a walnut case
5. sense_key=case%1:10:00:: | definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence | synonyms=grammatical case
6. sense_key=case%1:08:00:: | definition=an enveloping structure or covering enclosing an animal or plant organ or part | synonyms=sheath
7. sense_key=case%1:06:07:: | definition=the enclosing frame around a door or window opening | synonyms=casing | examples=the casings had rotted away and had to be replaced
8. sense_key=case%1:10:02:: | definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. sense_key=case%1:18:02:: | definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | synonyms=subject, guinea pig | examples=the subjects for this investigation were selected randomly; the cases that we studied were drawn from two different communities
10. sense_key=case%1:10:01:: | definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
11. sense_key=case%1:06:03:: | definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | synonyms=compositor's case, typesetter's case | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
12. sense_key=case%1:06:02:: | definition=bed linen consisting of a cover for a pillow | synonyms=pillowcase, slip, pillow slip | examples=the burglar carried his loot in a pillowcase
13. sense_key=case%1:09:00:: | definition=the actual state of things | examples=that was not the case
14. sense_key=case%1:26:00:: | definition=a special set of circumstances | synonyms=event | examples=in that event, the first possibility is excluded; it may rain in which case the picnic will be canceled
15. sense_key=case%1:26:02:: | definition=a specific state of mind that is temporary | examples=a case of the jitters
16. sense_key=case%1:06:00:: | definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
17. sense_key=case%1:10:03:: | definition=a specific size and style of type within a type family | synonyms=font, fount, typeface, face
18. sense_key=case%1:23:00:: | definition=the quantity contained in a case | synonyms=caseful
19. sense_key=case%1:06:01:: | definition=a glass container used to store and display items in a shop or museum or home | synonyms=display case, showcase, vitrine
20. sense_key=case%1:11:00:: | definition=an occurrence of something | synonyms=instance, example | examples=it was a case of bad judgment; another instance occurred yesterday

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  2. 2

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

  3. 3

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  4. 4

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  5. 5

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  6. 6

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  7. 7

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  8. 8

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
  9. 9

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  10. 10

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  11. 11

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  12. 12

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  13. 13

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
  14. 14

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

    Selected
  15. 15

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
  16. 16

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  17. 17

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

  18. 18

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  19. 19

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine

  20. 20

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

    Gold lexEN Gold Maru 2022 Gold Raganato

court Noun

Instance: semeval2013.d005.s005.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Cheshire Appeal Will Point to Twitter

There were half a dozen of them typing away in the courtroom rows.

Minute by minute, they sent out reports of gruesome testimony via Twitter.

In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze.

On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury.

But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years.

One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: courts
Context:
Cheshire Appeal Will Point to Twitter There were half a dozen of them typing away in the courtroom rows. Minute by minute, they sent out reports of gruesome testimony via Twitter. In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze. On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury. But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the <t>courts</t> for years. One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions.

Candidate senses:
1. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
2. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
3. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
4. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
5. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
6. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor
7. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
8. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
9. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
10. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
11. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  2. 2

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  3. 3

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  5. 5

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  6. 6

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

  7. 7

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  8. 8

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  9. 9

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  10. 10

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  11. 11

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected

rule Noun

Instance: semeval2013.d005.s014.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The trial judge, Jon C. Blue of State Superior Court, tersely rejected the claims in a ruling last week, saying that the news media were "carefully controlled" and that there was no evidence the jury was driven by passion.

But that is not likely to be the last word on the issue.

For decades, appeals courts have recognized that coverage of notorious cases can raise questions about a trial's fairness.

In a landmark 1966 ruling, the United States Supreme Court overturned the conviction of a Cleveland osteopath, Dr. Sam Sheppard, for the murder of his wife, saying in its decision, Sheppard v. Maxwell, that there was a "carnival atmosphere at trial" because of the news media.

The crime is believed by some to have been the inspiration for the television show and the movie "The Fugitive."

Some lawyers said appeals courts reviewing Mr. Hayes's conviction half a century later might be intrigued by the argument that new rules could be necessary to govern ways of communicating from courtrooms unimagined at the time of Dr. Sheppard's case.

"There is a general reason for concern about the impact of the new media" in high-profile trials, said John J. Donohue III, a Stanford Law School professor who studied the Connecticut death penalty and wrote a report that said it was arbitrarily enforced.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: rule
Target surface form: rules
Context:
The trial judge, Jon C. Blue of State Superior Court, tersely rejected the claims in a ruling last week, saying that the news media were "carefully controlled" and that there was no evidence the jury was driven by passion. But that is not likely to be the last word on the issue. For decades, appeals courts have recognized that coverage of notorious cases can raise questions about a trial's fairness. In a landmark 1966 ruling, the United States Supreme Court overturned the conviction of a Cleveland osteopath, Dr. Sam Sheppard, for the murder of his wife, saying in its decision, Sheppard v. Maxwell, that there was a "carnival atmosphere at trial" because of the news media. The crime is believed by some to have been the inspiration for the television show and the movie "The Fugitive." Some lawyers said appeals courts reviewing Mr. Hayes's conviction half a century later might be intrigued by the argument that new <t>rules</t> could be necessary to govern ways of communicating from courtrooms unimagined at the time of Dr. Sheppard's case. "There is a general reason for concern about the impact of the new media" in high-profile trials, said John J. Donohue III, a Stanford Law School professor who studied the Connecticut death penalty and wrote a report that said it was arbitrarily enforced.

Candidate senses:
1. sense_key=rule%1:09:03:: | definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | synonyms=principle | examples=their principles of composition characterized all their works
2. sense_key=rule%1:10:01:: | definition=(linguistics) a rule describing (or prescribing) a linguistic practice | synonyms=linguistic rule
3. sense_key=rule%1:09:04:: | definition=(mathematics) a standard procedure for solving a class of mathematical problems | synonyms=formula | examples=he determined the upper bound with Descartes' rule of signs; he gave us a general formula for attacking polynomials
4. sense_key=rule%1:10:03:: | definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
5. sense_key=rule%1:28:00:: | definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
6. sense_key=rule%1:09:00:: | definition=a principle or condition that customarily governs behavior | synonyms=regulation | examples=it was his rule to take a walk before breakfast; short haircuts were the regulation
7. sense_key=rule%1:06:00:: | definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths | synonyms=ruler
8. sense_key=rule%1:10:02:: | definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
9. sense_key=rule%1:09:02:: | definition=a rule or law concerning a natural phenomenon or the function of a complex system | synonyms=principle | examples=the principle of the conservation of mass; the principle of jet propulsion
10. sense_key=rule%1:26:00:: | definition=dominance or power through legal authority | synonyms=dominion | examples=France held undisputed dominion over vast areas of Africa; the rule of Caesar
11. sense_key=rule%1:09:01:: | definition=something regarded as a normative example | synonyms=convention, normal, pattern, formula | examples=the convention of not naming the main character; violence is the rule not the exception
12. sense_key=rule%1:10:00:: | definition=prescribed guide for conduct or action | synonyms=prescript

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  2. 2

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  3. 3

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  4. 4

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic
  5. 5

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  6. 6

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

  7. 7

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler

  8. 8

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
  9. 9

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  10. 10

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

    Selected
  11. 11

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

  12. 12

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

    Gold lexEN Gold Maru 2022 Gold Raganato

issue Noun

Instance: semeval2013.d005.s017.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

In a landmark 1966 ruling, the United States Supreme Court overturned the conviction of a Cleveland osteopath, Dr. Sam Sheppard, for the murder of his wife, saying in its decision, Sheppard v. Maxwell, that there was a "carnival atmosphere at trial" because of the news media.

The crime is believed by some to have been the inspiration for the television show and the movie "The Fugitive."

Some lawyers said appeals courts reviewing Mr. Hayes's conviction half a century later might be intrigued by the argument that new rules could be necessary to govern ways of communicating from courtrooms unimagined at the time of Dr. Sheppard's case.

"There is a general reason for concern about the impact of the new media" in high-profile trials, said John J. Donohue III, a Stanford Law School professor who studied the Connecticut death penalty and wrote a report that said it was arbitrarily enforced.

Professor Donohue said some appeals judges might be intrigued by the idea that limiting instant communication from courtrooms might make trials fairer.

The Twitter issue is just one of many outlined by Mr. Hayes's lawyers that are likely to be argued for years, delaying an execution.

The defense lawyers also claim, for example, that Mr. Hayes may have been prejudiced when Judge Blue declined to allow them to test potential jurors' reactions by showing them grisly crime-scene photographs during jury selection.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: issue
Target surface form: issue
Context:
In a landmark 1966 ruling, the United States Supreme Court overturned the conviction of a Cleveland osteopath, Dr. Sam Sheppard, for the murder of his wife, saying in its decision, Sheppard v. Maxwell, that there was a "carnival atmosphere at trial" because of the news media. The crime is believed by some to have been the inspiration for the television show and the movie "The Fugitive." Some lawyers said appeals courts reviewing Mr. Hayes's conviction half a century later might be intrigued by the argument that new rules could be necessary to govern ways of communicating from courtrooms unimagined at the time of Dr. Sheppard's case. "There is a general reason for concern about the impact of the new media" in high-profile trials, said John J. Donohue III, a Stanford Law School professor who studied the Connecticut death penalty and wrote a report that said it was arbitrarily enforced. Professor Donohue said some appeals judges might be intrigued by the idea that limiting instant communication from courtrooms might make trials fairer. The Twitter <t>issue</t> is just one of many outlined by Mr. Hayes's lawyers that are likely to be argued for years, delaying an execution. The defense lawyers also claim, for example, that Mr. Hayes may have been prejudiced when Judge Blue declined to allow them to test potential jurors' reactions by showing them grisly crime-scene photographs during jury selection.

Candidate senses:
1. sense_key=issue%1:21:01:: | definition=supplies (as food or clothing or ammunition) issued by the government | synonyms=military issue, government issue
2. sense_key=issue%1:06:00:: | definition=an opening that permits escape or release | synonyms=exit, outlet, way out | examples=he blocked the way out; the canyon had only one issue
3. sense_key=issue%1:10:00:: | definition=one of a series published periodically | synonyms=number | examples=she found an old issue of the magazine in her dentist's waiting room
4. sense_key=issue%1:04:01:: | definition=the act of providing an item for general use or for official purposes (usually in quantity) | synonyms=issuing, issuance | examples=a new issue of stamps; the last issue of penicillin was over a month ago
5. sense_key=issue%1:09:01:: | definition=an important question that is in dispute and must be settled | examples=the issue could be settled by requiring public education for everyone; politicians never discuss the real issues
6. sense_key=issue%1:21:00:: | definition=the income or profit arising from such transactions as the sale of land or other property | synonyms=return, take, takings, proceeds, yield, payoff | examples=the average return was about 5%
7. sense_key=issue%1:04:00:: | definition=the act of issuing printed materials | synonyms=publication
8. sense_key=issue%1:19:00:: | definition=a phenomenon that follows and is caused by some previous phenomenon | synonyms=consequence, effect, outcome, result, event, upshot | examples=the magnetic effect was greater when the rod was lengthwise; his decision had depressing consequences for business
9. sense_key=issue%1:11:00:: | definition=the becoming visible | synonyms=emergence, egress | examples=not a day's difference between the emergence of the andrenas and the opening of the willow catkins
10. sense_key=issue%1:09:00:: | definition=some situation or event that is thought about | synonyms=topic, subject, matter | examples=he kept drifting off the topic; he had been thinking about the subject for several years
11. sense_key=issue%1:18:00:: | definition=the immediate descendants of a person | synonyms=offspring, progeny | examples=she was the mother of many offspring; he died without issue

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    supplies (as food or clothing or ammunition) issued by the government

    issue%1:21:01:: · issue.n.05

    Synonyms: military issue, government issue

  2. 2

    an opening that permits escape or release

    issue%1:06:00:: · exit.n.01

    • he blocked the way out
    • the canyon had only one issue

    Synonyms: exit, outlet, way out

  3. 3

    one of a series published periodically

    issue%1:10:00:: · issue.n.02

    • she found an old issue of the magazine in her dentist's waiting room

    Synonyms: number

  4. 4

    the act of providing an item for general use or for official purposes (usually in quantity)

    issue%1:04:01:: · issue.n.04

    • a new issue of stamps
    • the last issue of penicillin was over a month ago

    Synonyms: issuing, issuance

  5. 5

    an important question that is in dispute and must be settled

    issue%1:09:01:: · issue.n.01

    • the issue could be settled by requiring public education for everyone
    • politicians never discuss the real issues
    Gold lexEN Gold Maru 2022 Gold Raganato
  6. 6

    the income or profit arising from such transactions as the sale of land or other property

    issue%1:21:00:: · return.n.06

    • the average return was about 5%

    Synonyms: return, take, takings, proceeds, yield, payoff

  7. 7

    the act of issuing printed materials

    issue%1:04:00:: · issue.n.11

    Synonyms: publication

  8. 8

    a phenomenon that follows and is caused by some previous phenomenon

    issue%1:19:00:: · consequence.n.01

    • the magnetic effect was greater when the rod was lengthwise
    • his decision had depressing consequences for business

    Synonyms: consequence, effect, outcome, result, event, upshot

  9. 9

    the becoming visible

    issue%1:11:00:: · emergence.n.02

    • not a day's difference between the emergence of the andrenas and the opening of the willow catkins

    Synonyms: emergence, egress

  10. 10

    some situation or event that is thought about

    issue%1:09:00:: · topic.n.02

    • he kept drifting off the topic
    • he had been thinking about the subject for several years

    Synonyms: topic, subject, matter

    Selected
  11. 11

    the immediate descendants of a person

    issue%1:18:00:: · offspring.n.01

    • she was the mother of many offspring
    • he died without issue

    Synonyms: offspring, progeny

court Noun

Instance: semeval2013.d005.s027.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But their arguments about the effect of the intense coverage of the trial may draw the most interest.

They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

They argued that the news media continually fanned the flames of emotion about the case.

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: court
Context:
But their arguments about the effect of the intense coverage of the trial may draw the most interest. They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate. They argued that the news media continually fanned the flames of emotion about the case. "The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor <t>court</t> policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Candidate senses:
1. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
2. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
3. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
4. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
5. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor
6. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
7. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
8. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
10. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
11. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  2. 2

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  3. 3

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  5. 5

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

  6. 6

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  7. 7

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  10. 10

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  11. 11

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court

court Noun

Instance: semeval2013.d005.s028.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

They argued that the news media continually fanned the flames of emotion about the case.

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Mr. Hayes's lawyers are pressing that claim.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: courts
Context:
They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate. They argued that the news media continually fanned the flames of emotion about the case. "The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the <t>courts</t>. Mr. Hayes's lawyers are pressing that claim.

Candidate senses:
1. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
2. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
3. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
4. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
5. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
6. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor
7. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
8. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
9. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
10. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
11. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  2. 2

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  4. 4

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  5. 5

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  6. 6

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

  7. 7

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  8. 8

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  9. 9

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  10. 10

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  11. 11

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance