Verified run

microsoft/Phi-4-mini-instruct

vllm-phi-4-mini-bf16-a100-p001-lexen-v1-20260614

Rank
174
Accuracy lexEN v1 · WordNet fine
63.98%
Correct
3110 / 4861
Actual run cost
$0.0282
Cost / M items
$5.80

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 63.98% 3110 / 4861 81.22% 3948 / 4861 75.19% 3655 / 4861
Maru 2022 (ALLamended) 63.46% 3085 / 4861 80.85% 3930 / 4861 74.96% 3644 / 4861
Raganato 2017 (original) 59.19% 2877 / 4861 78.98% 3839 / 4861 72.06% 3503 / 4861

Model

Display
microsoft/Phi-4-mini-instruct
Requested
hosted_vllm/microsoft/Phi-4-mini-instruct
Resolved
microsoft/Phi-4-mini-instruct
Vendor
Microsoft
API provider
n/a
Hosting
self_hosted
Source
open_source
License
MIT
Reasoning
n/a
Model URL
https://huggingface.co/microsoft/Phi-4-mini-instruct
Endpoint
http://localhost:8000/v1
Resolved counts
microsoft/Phi-4-mini-instruct: 4861
HF revision
cfbefacb99257ffa30c83adab238a50856ac3083
Quantization
bf16
Inference engine
vllm
Engine version
0.22.1
Container image
vllm/vllm-openai:v0.22.1
Serve command
exec vllm serve microsoft/Phi-4-mini-instruct --port 8000 --served-model-name microsoft/Phi-4-mini-instruct --max-model-len 8192 --gpu-memory-utilization 0.90 --trust-remote-code --revision cfbefacb99257ffa30c83adab238a50856ac3083

Reproducibility

Created
2026-06-14T20:23:39.820467+00:00
Run schema
sensebench-run-v2
Commit
n/a
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p001
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
2,986,047
Tokens / item
614.3
Total cost
$0.0282
Cost / M items
$5.80
Cost source
machine_time_estimate
Elapsed
1.55m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Machine & Timing

GPU
NVIDIA A100-SXM4-80GB
VRAM / GPU
81,920 MiB
Driver
570.195.03
CUDA
13.0
CPU
AMD EPYC 7513 32-Core Processor (128 cores)
RAM
1,385.7 GiB
Platform
Linux-5.15.0-160-generic-x86_64-with-glibc2.35
Provider
vast.ai (40919271)
Hourly rate
$1.09/h
Benchmark time
1.55m
Machine-hours / 1M items
5.30 h/M
Concurrency
96

Benchmark time covers only the per-item evaluation loop on this machine, excluding model and asset loading.

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
2,048
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.0282. Cost estimate source: machine_time_estimate. Cost is estimated from machine time multiplied by the recorded hourly rate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 2,947,159 n/a n/a
Input cached n/a n/a n/a
Output 38,888 n/a n/a
Reasoning output n/a included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 35.52% 282 794
Candidate Count 2 81.75% 699 855
Candidate Count 3-5 71.88% 1398 1945
Candidate Count 6-10 57.70% 731 1267
POS ADJ 68.89% 454 659
POS ADV 60.51% 118 195
POS NOUN 69.00% 1999 2897
POS VERB 48.56% 539 1110
Source Dataset semeval2013 67.89% 774 1140
Source Dataset semeval2015 65.63% 485 739
Source Dataset senseval2 64.64% 1053 1629
Source Dataset senseval3 58.98% 798 1353

Worst-Bucket Examples

cut Noun

Instance: semeval2013.d000.s012.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Michael Zammit Cutajar, who drafted the six-page document, boiled down a 180-page negotiation text to focus on what the U.N.'s top climate official, Yvo de Boer, described as "the big picture."

It shows the outlines for a possible deal, in which industrial nations would collectively cut their emissions by 2020 by 25 to 45 percent compared with 1990 levels, while major developing countries would reduce theirs during the same period by 15 to 30 percent.

Together, the countries would cut emissions between 50 and 95 percent by 2050.

The European Union gave the talks a boost as well on Friday by pledging to provide $3.6 billion a year over the next three years to help poorer countries adapt to the impact of climate change -- from coping with flood and drought to avoiding deforestation.

Still, Friday featured the same sort of verbal fireworks that have dominated the talks for the past week.

U.S. special climate envoy Todd Stern rejected language requiring binding cuts of greenhouse-gas emissions for industrialized countries compared with voluntary ones by major emerging economies if they were not funded by the developed world.

The move signaled that the Obama administration is taking a harder line with China than Bush administration officials did just two years ago.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: cut
Target surface form: cuts
Context:
Michael Zammit Cutajar, who drafted the six-page document, boiled down a 180-page negotiation text to focus on what the U.N.'s top climate official, Yvo de Boer, described as "the big picture." It shows the outlines for a possible deal, in which industrial nations would collectively cut their emissions by 2020 by 25 to 45 percent compared with 1990 levels, while major developing countries would reduce theirs during the same period by 15 to 30 percent. Together, the countries would cut emissions between 50 and 95 percent by 2050. The European Union gave the talks a boost as well on Friday by pledging to provide $3.6 billion a year over the next three years to help poorer countries adapt to the impact of climate change -- from coping with flood and drought to avoiding deforestation. Still, Friday featured the same sort of verbal fireworks that have dominated the talks for the past week. U.S. special climate envoy Todd Stern rejected language requiring binding <t>cuts</t> of greenhouse-gas emissions for industrialized countries compared with voluntary ones by major emerging economies if they were not funded by the developed world. The move signaled that the Obama administration is taking a harder line with China than Bush administration officials did just two years ago.

Candidate senses:
1. sense_key=cut%1:21:00:: | definition=a share of the profits | examples=everyone got a cut of the earnings
2. sense_key=cut%1:10:00:: | definition=(film) an immediate transition from one shot to the next | examples=the cut from the accident scene to the hospital seemed too abrupt
3. sense_key=cut%1:06:00:: | definition=a trench resembling a furrow that was made by erosion or excavation | synonyms=gash
4. sense_key=cut%1:26:01:: | definition=a step on some scale | examples=he is a cut above the rest
5. sense_key=cut%1:26:00:: | definition=a wound made by cutting | synonyms=gash, slash, slice | examples=he put a bandage over the cut
6. sense_key=cut%1:13:00:: | definition=a piece of meat that has been cut from an animal carcass | synonyms=cut of meat
7. sense_key=cut%1:10:02:: | definition=a remark capable of wounding mentally | synonyms=stinger | examples=the unkindest cut of all
8. sense_key=cut%1:10:04:: | definition=a distinct selection of music from a recording or a compact disc | synonyms=track | examples=he played the first cut on the cd; the title track of the album
9. sense_key=cut%1:10:01:: | definition=the omission that is made when an editorial change shortens a written passage | synonyms=deletion, excision | examples=an editor's deletions frequently upset young authors; both parties agreed on the excision of the proposed clause
10. sense_key=cut%1:09:00:: | definition=the style in which a garment is cut | examples=a dress of traditional cut
11. sense_key=cut%1:06:01:: | definition=a canal made by erosion or excavation
12. sense_key=cut%1:04:03:: | definition=a refusal to recognize someone you know | synonyms=snub, cold shoulder | examples=the snub was clearly intentional
13. sense_key=cut%1:04:07:: | definition=in baseball; a batter's attempt to hit a pitched ball | synonyms=baseball swing, swing | examples=he took a vicious cut at the ball
14. sense_key=cut%1:04:08:: | definition=(sports) a stroke that puts reverse spin on the ball | synonyms=undercut | examples=cuts do not bother a good tennis player
15. sense_key=cut%1:04:09:: | definition=the division of a deck of cards before dealing | synonyms=cutting | examples=he insisted that we give him the last cut before every deal; the cutting of the cards soon became a ritual
16. sense_key=cut%1:04:02:: | definition=the act of penetrating or opening open with a sharp edge | synonyms=cutting | examples=his cut in the lining revealed the hidden jewels
17. sense_key=cut%1:04:01:: | definition=the act of cutting something into parts | synonyms=cutting | examples=his cuts were skillful; his cutting of the cake made a terrible mess
18. sense_key=cut%1:04:00:: | definition=the act of shortening something by chopping off the ends | synonyms=cutting, cutting off | examples=the barber gave him a good cut
19. sense_key=cut%1:04:05:: | definition=the act of reducing the amount or number | examples=the mayor proposed extensive cuts in the city budget
20. sense_key=cut%1:04:06:: | definition=an unexcused absence from class | examples=he was punished for taking too many cuts in his math class

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a share of the profits

    cut%1:21:00:: · cut.n.01

    • everyone got a cut of the earnings
  2. 2

    (film) an immediate transition from one shot to the next

    cut%1:10:00:: · cut.n.02

    • the cut from the accident scene to the hospital seemed too abrupt
  3. 3

    a trench resembling a furrow that was made by erosion or excavation

    cut%1:06:00:: · cut.n.03

    Synonyms: gash

  4. 4

    a step on some scale

    cut%1:26:01:: · cut.n.04

    • he is a cut above the rest
  5. 5

    a wound made by cutting

    cut%1:26:00:: · cut.n.05

    • he put a bandage over the cut

    Synonyms: gash, slash, slice

    Selected
  6. 6

    a piece of meat that has been cut from an animal carcass

    cut%1:13:00:: · cut.n.06

    Synonyms: cut of meat

  7. 7

    a remark capable of wounding mentally

    cut%1:10:02:: · stinger.n.02

    • the unkindest cut of all

    Synonyms: stinger

  8. 8

    a distinct selection of music from a recording or a compact disc

    cut%1:10:04:: · cut.n.08

    • he played the first cut on the cd
    • the title track of the album

    Synonyms: track

  9. 9

    the omission that is made when an editorial change shortens a written passage

    cut%1:10:01:: · deletion.n.03

    • an editor's deletions frequently upset young authors
    • both parties agreed on the excision of the proposed clause

    Synonyms: deletion, excision

  10. 10

    the style in which a garment is cut

    cut%1:09:00:: · cut.n.10

    • a dress of traditional cut
  11. 11

    a canal made by erosion or excavation

    cut%1:06:01:: · cut.n.11

  12. 12

    a refusal to recognize someone you know

    cut%1:04:03:: · snub.n.02

    • the snub was clearly intentional

    Synonyms: snub, cold shoulder

  13. 13

    in baseball; a batter's attempt to hit a pitched ball

    cut%1:04:07:: · baseball_swing.n.01

    • he took a vicious cut at the ball

    Synonyms: baseball swing, swing

  14. 14

    (sports) a stroke that puts reverse spin on the ball

    cut%1:04:08:: · cut.n.14

    • cuts do not bother a good tennis player

    Synonyms: undercut

  15. 15

    the division of a deck of cards before dealing

    cut%1:04:09:: · cut.n.15

    • he insisted that we give him the last cut before every deal
    • the cutting of the cards soon became a ritual

    Synonyms: cutting

  16. 16

    the act of penetrating or opening open with a sharp edge

    cut%1:04:02:: · cut.n.16

    • his cut in the lining revealed the hidden jewels

    Synonyms: cutting

  17. 17

    the act of cutting something into parts

    cut%1:04:01:: · cut.n.17

    • his cuts were skillful
    • his cutting of the cake made a terrible mess

    Synonyms: cutting

  18. 18

    the act of shortening something by chopping off the ends

    cut%1:04:00:: · cut.n.18

    • the barber gave him a good cut

    Synonyms: cutting, cutting off

  19. 19

    the act of reducing the amount or number

    cut%1:04:05:: · cut.n.19

    • the mayor proposed extensive cuts in the city budget
    Gold lexEN Gold Maru 2022 Gold Raganato
  20. 20

    an unexcused absence from class

    cut%1:04:06:: · cut.n.20

    • he was punished for taking too many cuts in his math class

cut Noun

Instance: semeval2013.d000.s014.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Together, the countries would cut emissions between 50 and 95 percent by 2050.

The European Union gave the talks a boost as well on Friday by pledging to provide $3.6 billion a year over the next three years to help poorer countries adapt to the impact of climate change -- from coping with flood and drought to avoiding deforestation.

Still, Friday featured the same sort of verbal fireworks that have dominated the talks for the past week.

U.S. special climate envoy Todd Stern rejected language requiring binding cuts of greenhouse-gas emissions for industrialized countries compared with voluntary ones by major emerging economies if they were not funded by the developed world.

The move signaled that the Obama administration is taking a harder line with China than Bush administration officials did just two years ago.

The United States is not going to do a deal without the major developing countries stepping up and taking action, said Stern, who also complained that the text did not do enough to make sure the cuts could be verified by outside observers.

Stern made his comments an hour after Chinese vice foreign minister He Yafei said America's top climate negotiator was either lacking "common sense" or being "extremely irresponsible" for saying earlier in the week that the United States would not help China financially to cope with global warming.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: cut
Target surface form: cuts
Context:
Together, the countries would cut emissions between 50 and 95 percent by 2050. The European Union gave the talks a boost as well on Friday by pledging to provide $3.6 billion a year over the next three years to help poorer countries adapt to the impact of climate change -- from coping with flood and drought to avoiding deforestation. Still, Friday featured the same sort of verbal fireworks that have dominated the talks for the past week. U.S. special climate envoy Todd Stern rejected language requiring binding cuts of greenhouse-gas emissions for industrialized countries compared with voluntary ones by major emerging economies if they were not funded by the developed world. The move signaled that the Obama administration is taking a harder line with China than Bush administration officials did just two years ago. The United States is not going to do a deal without the major developing countries stepping up and taking action, said Stern, who also complained that the text did not do enough to make sure the <t>cuts</t> could be verified by outside observers. Stern made his comments an hour after Chinese vice foreign minister He Yafei said America's top climate negotiator was either lacking "common sense" or being "extremely irresponsible" for saying earlier in the week that the United States would not help China financially to cope with global warming.

Candidate senses:
1. sense_key=cut%1:21:00:: | definition=a share of the profits | examples=everyone got a cut of the earnings
2. sense_key=cut%1:10:00:: | definition=(film) an immediate transition from one shot to the next | examples=the cut from the accident scene to the hospital seemed too abrupt
3. sense_key=cut%1:06:00:: | definition=a trench resembling a furrow that was made by erosion or excavation | synonyms=gash
4. sense_key=cut%1:26:01:: | definition=a step on some scale | examples=he is a cut above the rest
5. sense_key=cut%1:26:00:: | definition=a wound made by cutting | synonyms=gash, slash, slice | examples=he put a bandage over the cut
6. sense_key=cut%1:13:00:: | definition=a piece of meat that has been cut from an animal carcass | synonyms=cut of meat
7. sense_key=cut%1:10:02:: | definition=a remark capable of wounding mentally | synonyms=stinger | examples=the unkindest cut of all
8. sense_key=cut%1:10:04:: | definition=a distinct selection of music from a recording or a compact disc | synonyms=track | examples=he played the first cut on the cd; the title track of the album
9. sense_key=cut%1:10:01:: | definition=the omission that is made when an editorial change shortens a written passage | synonyms=deletion, excision | examples=an editor's deletions frequently upset young authors; both parties agreed on the excision of the proposed clause
10. sense_key=cut%1:09:00:: | definition=the style in which a garment is cut | examples=a dress of traditional cut
11. sense_key=cut%1:06:01:: | definition=a canal made by erosion or excavation
12. sense_key=cut%1:04:03:: | definition=a refusal to recognize someone you know | synonyms=snub, cold shoulder | examples=the snub was clearly intentional
13. sense_key=cut%1:04:07:: | definition=in baseball; a batter's attempt to hit a pitched ball | synonyms=baseball swing, swing | examples=he took a vicious cut at the ball
14. sense_key=cut%1:04:08:: | definition=(sports) a stroke that puts reverse spin on the ball | synonyms=undercut | examples=cuts do not bother a good tennis player
15. sense_key=cut%1:04:09:: | definition=the division of a deck of cards before dealing | synonyms=cutting | examples=he insisted that we give him the last cut before every deal; the cutting of the cards soon became a ritual
16. sense_key=cut%1:04:02:: | definition=the act of penetrating or opening open with a sharp edge | synonyms=cutting | examples=his cut in the lining revealed the hidden jewels
17. sense_key=cut%1:04:01:: | definition=the act of cutting something into parts | synonyms=cutting | examples=his cuts were skillful; his cutting of the cake made a terrible mess
18. sense_key=cut%1:04:00:: | definition=the act of shortening something by chopping off the ends | synonyms=cutting, cutting off | examples=the barber gave him a good cut
19. sense_key=cut%1:04:05:: | definition=the act of reducing the amount or number | examples=the mayor proposed extensive cuts in the city budget
20. sense_key=cut%1:04:06:: | definition=an unexcused absence from class | examples=he was punished for taking too many cuts in his math class

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a share of the profits

    cut%1:21:00:: · cut.n.01

    • everyone got a cut of the earnings
  2. 2

    (film) an immediate transition from one shot to the next

    cut%1:10:00:: · cut.n.02

    • the cut from the accident scene to the hospital seemed too abrupt
  3. 3

    a trench resembling a furrow that was made by erosion or excavation

    cut%1:06:00:: · cut.n.03

    Synonyms: gash

  4. 4

    a step on some scale

    cut%1:26:01:: · cut.n.04

    • he is a cut above the rest
  5. 5

    a wound made by cutting

    cut%1:26:00:: · cut.n.05

    • he put a bandage over the cut

    Synonyms: gash, slash, slice

    Selected
  6. 6

    a piece of meat that has been cut from an animal carcass

    cut%1:13:00:: · cut.n.06

    Synonyms: cut of meat

  7. 7

    a remark capable of wounding mentally

    cut%1:10:02:: · stinger.n.02

    • the unkindest cut of all

    Synonyms: stinger

  8. 8

    a distinct selection of music from a recording or a compact disc

    cut%1:10:04:: · cut.n.08

    • he played the first cut on the cd
    • the title track of the album

    Synonyms: track

  9. 9

    the omission that is made when an editorial change shortens a written passage

    cut%1:10:01:: · deletion.n.03

    • an editor's deletions frequently upset young authors
    • both parties agreed on the excision of the proposed clause

    Synonyms: deletion, excision

  10. 10

    the style in which a garment is cut

    cut%1:09:00:: · cut.n.10

    • a dress of traditional cut
  11. 11

    a canal made by erosion or excavation

    cut%1:06:01:: · cut.n.11

  12. 12

    a refusal to recognize someone you know

    cut%1:04:03:: · snub.n.02

    • the snub was clearly intentional

    Synonyms: snub, cold shoulder

  13. 13

    in baseball; a batter's attempt to hit a pitched ball

    cut%1:04:07:: · baseball_swing.n.01

    • he took a vicious cut at the ball

    Synonyms: baseball swing, swing

  14. 14

    (sports) a stroke that puts reverse spin on the ball

    cut%1:04:08:: · cut.n.14

    • cuts do not bother a good tennis player

    Synonyms: undercut

  15. 15

    the division of a deck of cards before dealing

    cut%1:04:09:: · cut.n.15

    • he insisted that we give him the last cut before every deal
    • the cutting of the cards soon became a ritual

    Synonyms: cutting

  16. 16

    the act of penetrating or opening open with a sharp edge

    cut%1:04:02:: · cut.n.16

    • his cut in the lining revealed the hidden jewels

    Synonyms: cutting

  17. 17

    the act of cutting something into parts

    cut%1:04:01:: · cut.n.17

    • his cuts were skillful
    • his cutting of the cake made a terrible mess

    Synonyms: cutting

  18. 18

    the act of shortening something by chopping off the ends

    cut%1:04:00:: · cut.n.18

    • the barber gave him a good cut

    Synonyms: cutting, cutting off

  19. 19

    the act of reducing the amount or number

    cut%1:04:05:: · cut.n.19

    • the mayor proposed extensive cuts in the city budget
    Gold lexEN Gold Maru 2022 Gold Raganato
  20. 20

    an unexcused absence from class

    cut%1:04:06:: · cut.n.20

    • he was punished for taking too many cuts in his math class

hall Noun

Instance: semeval2013.d000.s024.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

This is clearly a game where a new economic hegemony is being developed, said Ulate, who also serves as the regional Mexico and Central America climate change adviser for Conservation International.

Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best.

The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning.

Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India.

The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding issues before the heads of government arrive to strike a deal.

High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's halls to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week.

The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and draft proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: hall
Target surface form: halls
Context:
This is clearly a game where a new economic hegemony is being developed, said Ulate, who also serves as the regional Mexico and Central America climate change adviser for Conservation International. Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best. The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning. Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India. The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding issues before the heads of government arrive to strike a deal. High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's <t>halls</t> to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week. The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and draft proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge.

Candidate senses:
1. sense_key=hall%1:06:03:: | definition=an interior passage or corridor onto which rooms open | synonyms=hallway | examples=the elevators were at the end of the hall
2. sense_key=hall%1:06:05:: | definition=a large entrance or reception room or area | synonyms=anteroom, antechamber, entrance hall, foyer, lobby, vestibule
3. sense_key=hall%1:06:02:: | definition=a large room for gatherings or entertainment | examples=lecture hall; pool hall
4. sense_key=hall%1:06:04:: | definition=a college or university building containing living quarters for students | synonyms=dormitory, dorm, residence hall, student residence
5. sense_key=hall%1:06:06:: | definition=the large room of a manor or castle | synonyms=manor hall
6. sense_key=hall%1:18:04:: | definition=English writer whose novel about a lesbian relationship was banned in Britain for many years (1883-1943) | synonyms=Radclyffe Hall, Marguerite Radclyffe Hall
7. sense_key=hall%1:18:03:: | definition=United States child psychologist whose theories of child psychology strongly influenced educational psychology (1844-1924) | synonyms=G. Stanley Hall, Granville Stanley Hall
8. sense_key=hall%1:18:02:: | definition=United States chemist who developed an economical method of producing aluminum from bauxite (1863-1914) | synonyms=Charles Martin Hall
9. sense_key=hall%1:18:01:: | definition=United States explorer who led three expeditions to the Arctic (1821-1871) | synonyms=Charles Francis Hall
10. sense_key=hall%1:18:00:: | definition=United States astronomer who discovered Phobos and Deimos (the two satellites of Mars) (1829-1907) | synonyms=Asaph Hall
11. sense_key=hall%1:06:07:: | definition=a large and imposing house | synonyms=mansion, mansion house, manse, residence
12. sense_key=hall%1:06:08:: | definition=a large building used by a college or university for teaching or research | examples=halls of learning
13. sense_key=hall%1:06:01:: | definition=a large building for meetings or entertainment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an interior passage or corridor onto which rooms open

    hall%1:06:03:: · hallway.n.01

    • the elevators were at the end of the hall

    Synonyms: hallway

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a large entrance or reception room or area

    hall%1:06:05:: · anteroom.n.01

    Synonyms: anteroom, antechamber, entrance hall, foyer, lobby, vestibule

    Gold lexEN Gold Maru 2022
  3. 3

    a large room for gatherings or entertainment

    hall%1:06:02:: · hall.n.03

    • lecture hall
    • pool hall
    Gold lexEN Gold Maru 2022
  4. 4

    a college or university building containing living quarters for students

    hall%1:06:04:: · dormitory.n.01

    Synonyms: dormitory, dorm, residence hall, student residence

  5. 5

    the large room of a manor or castle

    hall%1:06:06:: · manor_hall.n.01

    Synonyms: manor hall

  6. 6

    English writer whose novel about a lesbian relationship was banned in Britain for many years (1883-1943)

    hall%1:18:04:: · hall.n.06

    Synonyms: Radclyffe Hall, Marguerite Radclyffe Hall

  7. 7

    United States child psychologist whose theories of child psychology strongly influenced educational psychology (1844-1924)

    hall%1:18:03:: · hall.n.07

    Synonyms: G. Stanley Hall, Granville Stanley Hall

  8. 8

    United States chemist who developed an economical method of producing aluminum from bauxite (1863-1914)

    hall%1:18:02:: · hall.n.08

    Synonyms: Charles Martin Hall

  9. 9

    United States explorer who led three expeditions to the Arctic (1821-1871)

    hall%1:18:01:: · hall.n.09

    Synonyms: Charles Francis Hall

  10. 10

    United States astronomer who discovered Phobos and Deimos (the two satellites of Mars) (1829-1907)

    hall%1:18:00:: · hall.n.10

    Synonyms: Asaph Hall

  11. 11

    a large and imposing house

    hall%1:06:07:: · mansion.n.02

    Synonyms: mansion, mansion house, manse, residence

  12. 12

    a large building used by a college or university for teaching or research

    hall%1:06:08:: · hall.n.12

    • halls of learning
  13. 13

    a large building for meetings or entertainment

    hall%1:06:01:: · hall.n.13

    Selected

draft Noun

Instance: semeval2013.d000.s025.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best.

The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning.

Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India.

The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding issues before the heads of government arrive to strike a deal.

High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's halls to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week.

The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and draft proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge.

The intensity is only building: nearly all of the key ministers are now here, and as early as Wednesday 60 heads of government will be in Copenhagen.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: draft
Target surface form: draft
Context:
Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best. The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning. Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India. The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding issues before the heads of government arrive to strike a deal. High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's halls to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week. The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and <t>draft</t> proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge. The intensity is only building: nearly all of the key ministers are now here, and as early as Wednesday 60 heads of government will be in Copenhagen.

Candidate senses:
1. sense_key=draft%1:21:00:: | definition=a document ordering the payment of money; drawn by one person or bank on another | synonyms=bill of exchange, order of payment
2. sense_key=draft%1:19:00:: | definition=a current of air (usually coming into a chimney or room or vehicle) | synonyms=draught
3. sense_key=draft%1:06:01:: | definition=a preliminary sketch of a design or picture | synonyms=rough drawing
4. sense_key=draft%1:13:00:: | definition=a serving of drink (usually alcoholic) drawn from a keg | synonyms=draught, potation, tipple | examples=they served beer on draft
5. sense_key=draft%1:10:00:: | definition=any of the various versions in the development of a written work | synonyms=draft copy | examples=a preliminary draft; the final draft of the constitution
6. sense_key=draft%1:07:00:: | definition=the depth of a vessel's keel below the surface (especially when loaded) | synonyms=draught
7. sense_key=draft%1:06:02:: | definition=a regulator for controlling the flow of air in a fireplace
8. sense_key=draft%1:06:00:: | definition=a dose of liquid medicine | synonyms=draught | examples=he took a sleeping draft
9. sense_key=draft%1:04:03:: | definition=compulsory military service | synonyms=conscription, muster, selective service
10. sense_key=draft%1:04:02:: | definition=a large and hurried swallow | synonyms=gulp, draught, swig | examples=he finished it at a single gulp
11. sense_key=draft%1:04:00:: | definition=the act of moving a load by drawing or pulling | synonyms=draught, drawing

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a document ordering the payment of money; drawn by one person or bank on another

    draft%1:21:00:: · draft.n.01

    Synonyms: bill of exchange, order of payment

  2. 2

    a current of air (usually coming into a chimney or room or vehicle)

    draft%1:19:00:: · draft.n.02

    Synonyms: draught

  3. 3

    a preliminary sketch of a design or picture

    draft%1:06:01:: · draft.n.03

    Synonyms: rough drawing

    Selected
  4. 4

    a serving of drink (usually alcoholic) drawn from a keg

    draft%1:13:00:: · draft.n.04

    • they served beer on draft

    Synonyms: draught, potation, tipple

  5. 5

    any of the various versions in the development of a written work

    draft%1:10:00:: · draft.n.05

    • a preliminary draft
    • the final draft of the constitution

    Synonyms: draft copy

    Gold lexEN Gold Maru 2022 Gold Raganato
  6. 6

    the depth of a vessel's keel below the surface (especially when loaded)

    draft%1:07:00:: · draft.n.06

    Synonyms: draught

  7. 7

    a regulator for controlling the flow of air in a fireplace

    draft%1:06:02:: · draft.n.07

  8. 8

    a dose of liquid medicine

    draft%1:06:00:: · draft.n.08

    • he took a sleeping draft

    Synonyms: draught

  9. 9

    compulsory military service

    draft%1:04:03:: · conscription.n.01

    Synonyms: conscription, muster, selective service

  10. 10

    a large and hurried swallow

    draft%1:04:02:: · gulp.n.01

    • he finished it at a single gulp

    Synonyms: gulp, draught, swig

  11. 11

    the act of moving a load by drawing or pulling

    draft%1:04:00:: · draft.n.11

    Synonyms: draught, drawing

game Noun

Instance: semeval2013.d001.s004.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Baskonia gives away a victory in Israel

Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group.

The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph.

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Baskonia gives away a victory in Israel Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group. The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory. Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph. The <t>game</t> started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
    Selected
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

lead Noun

Instance: semeval2013.d001.s007.t008 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph.

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: lead
Target surface form: lead
Context:
The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory. Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph. The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their <t>lead</t> by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

Candidate senses:
1. sense_key=lead%1:07:02:: | definition=an advantage held by a competitor in a race | examples=he took the lead at the last turn
2. sense_key=lead%1:27:00:: | definition=a soft heavy toxic malleable metallic element; bluish white when freshly cut but tarnishes readily to dull grey | synonyms=Pb, atomic number 82 | examples=the children were playing with lead soldiers
3. sense_key=lead%1:09:00:: | definition=evidence pointing to a possible solution | synonyms=track, trail | examples=the police are following a promising lead; the trail led straight to the perpetrator
4. sense_key=lead%1:04:01:: | definition=a position of leadership (especially in the phrase `take the lead') | examples=he takes the lead in any group; we were just waiting for someone to take the lead
5. sense_key=lead%1:25:00:: | definition=the angle between the direction a gun is aimed and the position of a moving target (correcting for the flight time of the missile)
6. sense_key=lead%1:10:01:: | definition=the introductory section of a story | synonyms=lead-in, lede | examples=it was an amusing lead-in to a very serious matter
7. sense_key=lead%1:23:00:: | definition=(sports) the score by which a team or individual is winning
8. sense_key=lead%1:18:00:: | definition=an actor who plays a principal role | synonyms=star, principal
9. sense_key=lead%1:15:00:: | definition=(baseball) the position taken by a base runner preparing to advance to the next base | examples=he took a long lead off first
10. sense_key=lead%1:10:02:: | definition=an indication of potential opportunity | synonyms=tip, steer, confidential information, wind, hint | examples=he got a tip on the stock market; a good lead for a job
11. sense_key=lead%1:10:00:: | definition=a news story of major importance | synonyms=lead story
12. sense_key=lead%1:07:01:: | definition=the timing of ignition relative to the position of the piston in an internal-combustion engine | synonyms=spark advance
13. sense_key=lead%1:06:03:: | definition=restraint consisting of a rope (or light chain) used to restrain an animal | synonyms=leash, tether
14. sense_key=lead%1:06:02:: | definition=thin strip of metal used to separate lines of type in printing | synonyms=leading
15. sense_key=lead%1:06:00:: | definition=mixture of graphite with clay in different degrees of hardness; the marking substance in a pencil | synonyms=pencil lead
16. sense_key=lead%1:06:01:: | definition=a jumper that consists of a short piece of wire | synonyms=jumper cable, jumper lead, booster cable | examples=it was a tangle of jumper cables and clip leads
17. sense_key=lead%1:04:00:: | definition=the playing of a card to start a trick in bridge | examples=the lead was in the dummy

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an advantage held by a competitor in a race

    lead%1:07:02:: · lead.n.01

    • he took the lead at the last turn
    Gold Raganato
  2. 2

    a soft heavy toxic malleable metallic element; bluish white when freshly cut but tarnishes readily to dull grey

    lead%1:27:00:: · lead.n.02

    • the children were playing with lead soldiers

    Synonyms: Pb, atomic number 82

  3. 3

    evidence pointing to a possible solution

    lead%1:09:00:: · lead.n.03

    • the police are following a promising lead
    • the trail led straight to the perpetrator

    Synonyms: track, trail

  4. 4

    a position of leadership (especially in the phrase `take the lead')

    lead%1:04:01:: · lead.n.04

    • he takes the lead in any group
    • we were just waiting for someone to take the lead
    Selected
  5. 5

    the angle between the direction a gun is aimed and the position of a moving target (correcting for the flight time of the missile)

    lead%1:25:00:: · lead.n.05

  6. 6

    the introductory section of a story

    lead%1:10:01:: · lead.n.06

    • it was an amusing lead-in to a very serious matter

    Synonyms: lead-in, lede

  7. 7

    (sports) the score by which a team or individual is winning

    lead%1:23:00:: · lead.n.07

    Gold lexEN Gold Maru 2022
  8. 8

    an actor who plays a principal role

    lead%1:18:00:: · star.n.04

    Synonyms: star, principal

  9. 9

    (baseball) the position taken by a base runner preparing to advance to the next base

    lead%1:15:00:: · lead.n.09

    • he took a long lead off first
  10. 10

    an indication of potential opportunity

    lead%1:10:02:: · tip.n.03

    • he got a tip on the stock market
    • a good lead for a job

    Synonyms: tip, steer, confidential information, wind, hint

  11. 11

    a news story of major importance

    lead%1:10:00:: · lead.n.11

    Synonyms: lead story

  12. 12

    the timing of ignition relative to the position of the piston in an internal-combustion engine

    lead%1:07:01:: · spark_advance.n.01

    Synonyms: spark advance

  13. 13

    restraint consisting of a rope (or light chain) used to restrain an animal

    lead%1:06:03:: · leash.n.01

    Synonyms: leash, tether

  14. 14

    thin strip of metal used to separate lines of type in printing

    lead%1:06:02:: · lead.n.14

    Synonyms: leading

  15. 15

    mixture of graphite with clay in different degrees of hardness; the marking substance in a pencil

    lead%1:06:00:: · lead.n.15

    Synonyms: pencil lead

  16. 16

    a jumper that consists of a short piece of wire

    lead%1:06:01:: · jumper_cable.n.01

    • it was a tangle of jumper cables and clip leads

    Synonyms: jumper cable, jumper lead, booster cable

  17. 17

    the playing of a card to start a trick in bridge

    lead%1:04:00:: · lead.n.17

    • the lead was in the dummy

game Noun

Instance: semeval2013.d001.s009.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the <t>game</t>, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
    Selected
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d001.s009.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the <t>game</t>. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
    Selected
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

play Noun

Instance: semeval2013.d001.s012.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: play
Target surface form: plays
Context:
The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game. Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of <t>plays</t> correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

Candidate senses:
1. sense_key=play%1:10:01:: | definition=a dramatic work intended for performance by actors on a stage | synonyms=drama, dramatic play | examples=he wrote several plays but only one was produced on Broadway
2. sense_key=play%1:10:03:: | definition=a theatrical performance of a drama | examples=the play lasted two hours
3. sense_key=play%1:04:05:: | definition=a preset plan of action in team sports | examples=the coach drew up the plays for her team
4. sense_key=play%1:04:04:: | definition=a deliberate coordinated movement requiring dexterity and skill | synonyms=maneuver, manoeuvre | examples=he made a great maneuver; the runner was out on a play by the shortstop
5. sense_key=play%1:26:00:: | definition=a state in which action is feasible | examples=the ball was still in play; insiders said the company's stock was in play
6. sense_key=play%1:04:08:: | definition=utilization or exercise | examples=the play of the imagination
7. sense_key=play%1:04:03:: | definition=an attempt to get something | synonyms=bid | examples=they made a futile play for power; he made a bid to gain attention
8. sense_key=play%1:04:06:: | definition=activity by children that is guided more by imagination than by fixed rules | synonyms=child's play | examples=Freud believed in the utility of play to a small child
9. sense_key=play%1:28:00:: | definition=(in games or plays or other performances) the time during which play proceeds | synonyms=playing period, period of play | examples=rain stopped play in the 4th inning
10. sense_key=play%1:26:01:: | definition=the removal of constraints | synonyms=free rein | examples=he gave free rein to his impulses; they gave full play to the artist's talent
11. sense_key=play%1:11:00:: | definition=a weak and tremulous light | synonyms=shimmer | examples=the shimmer of colors on iridescent feathers; the play of light on the water
12. sense_key=play%1:10:02:: | definition=verbal wit or mockery (often at another's expense but not to be taken seriously) | synonyms=fun, sport | examples=he became a figure of fun; he said it in sport
13. sense_key=play%1:07:00:: | definition=movement or space for movement | synonyms=looseness | examples=there was too much play in the steering wheel
14. sense_key=play%1:04:00:: | definition=gay or light-hearted recreational activity for diversion or amusement | synonyms=frolic, romp, gambol, caper | examples=it was all done in play; their frolic in the surf threatened to become ugly
15. sense_key=play%1:04:01:: | definition=(game) the activity of doing something in an agreed succession | synonyms=turn | examples=it is my turn; it is still my play
16. sense_key=play%1:04:02:: | definition=the act of playing for stakes in the hope of winning (including the payment of a price for a chance to win a prize) | synonyms=gambling, gaming | examples=his gambling cost him a fortune; there was heavy play at the blackjack table
17. sense_key=play%1:04:07:: | definition=the act using a sword (or other weapon) vigorously and skillfully | synonyms=swordplay

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a dramatic work intended for performance by actors on a stage

    play%1:10:01:: · play.n.01

    • he wrote several plays but only one was produced on Broadway

    Synonyms: drama, dramatic play

  2. 2

    a theatrical performance of a drama

    play%1:10:03:: · play.n.02

    • the play lasted two hours
  3. 3

    a preset plan of action in team sports

    play%1:04:05:: · play.n.03

    • the coach drew up the plays for her team
    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    a deliberate coordinated movement requiring dexterity and skill

    play%1:04:04:: · maneuver.n.03

    • he made a great maneuver
    • the runner was out on a play by the shortstop

    Synonyms: maneuver, manoeuvre

    Selected
  5. 5

    a state in which action is feasible

    play%1:26:00:: · play.n.05

    • the ball was still in play
    • insiders said the company's stock was in play
  6. 6

    utilization or exercise

    play%1:04:08:: · play.n.06

    • the play of the imagination
  7. 7

    an attempt to get something

    play%1:04:03:: · bid.n.02

    • they made a futile play for power
    • he made a bid to gain attention

    Synonyms: bid

  8. 8

    activity by children that is guided more by imagination than by fixed rules

    play%1:04:06:: · play.n.08

    • Freud believed in the utility of play to a small child

    Synonyms: child's play

  9. 9

    (in games or plays or other performances) the time during which play proceeds

    play%1:28:00:: · playing_period.n.01

    • rain stopped play in the 4th inning

    Synonyms: playing period, period of play

  10. 10

    the removal of constraints

    play%1:26:01:: · free_rein.n.01

    • he gave free rein to his impulses
    • they gave full play to the artist's talent

    Synonyms: free rein

  11. 11

    a weak and tremulous light

    play%1:11:00:: · shimmer.n.01

    • the shimmer of colors on iridescent feathers
    • the play of light on the water

    Synonyms: shimmer

  12. 12

    verbal wit or mockery (often at another's expense but not to be taken seriously)

    play%1:10:02:: · fun.n.02

    • he became a figure of fun
    • he said it in sport

    Synonyms: fun, sport

  13. 13

    movement or space for movement

    play%1:07:00:: · looseness.n.05

    • there was too much play in the steering wheel

    Synonyms: looseness

  14. 14

    gay or light-hearted recreational activity for diversion or amusement

    play%1:04:00:: · play.n.14

    • it was all done in play
    • their frolic in the surf threatened to become ugly

    Synonyms: frolic, romp, gambol, caper

  15. 15

    (game) the activity of doing something in an agreed succession

    play%1:04:01:: · turn.n.03

    • it is my turn
    • it is still my play

    Synonyms: turn

  16. 16

    the act of playing for stakes in the hope of winning (including the payment of a price for a chance to win a prize)

    play%1:04:02:: · gambling.n.01

    • his gambling cost him a fortune
    • there was heavy play at the blackjack table

    Synonyms: gambling, gaming

  17. 17

    the act using a sword (or other weapon) vigorously and skillfully

    play%1:04:07:: · play.n.17

    Synonyms: swordplay

line Noun

Instance: semeval2013.d001.s014.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77).

In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: line
Target surface form: line
Context:
But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game. Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes. However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point <t>line</t> (70-77). In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Candidate senses:
1. sense_key=line%1:14:03:: | definition=a formation of people or things one beside another | examples=the line of soldiers advanced with their bayonets fixed; they were arrayed in line of battle
2. sense_key=line%1:10:01:: | definition=a mark that is long relative to its width | examples=He drew a line on the chart
3. sense_key=line%1:14:01:: | definition=a formation of people or things one behind another | examples=the line stretched clear around the corner; you must wait in a long line at the checkout counter
4. sense_key=line%1:25:00:: | definition=a length (straight or curved) without breadth or thickness; the trace of a moving point
5. sense_key=line%1:10:02:: | definition=text consisting of a row of words written across a page or computer screen | examples=the letter consisted of three short lines; there are six lines in every stanza
6. sense_key=line%1:19:00:: | definition=a single frequency (or very narrow band) of radiation in a spectrum
7. sense_key=line%1:15:02:: | definition=a fortified position (especially one marking the most forward position of troops) | examples=they attacked the enemy's line
8. sense_key=line%1:09:01:: | definition=a course of reasoning aimed at demonstrating a truth or falsehood; the methodical process of logical reasoning | synonyms=argumentation, logical argument, argument, line of reasoning | examples=I can't follow your line of reasoning
9. sense_key=line%1:06:01:: | definition=a conductor for transmitting electrical or optical signals or electric power | synonyms=cable, transmission line
10. sense_key=line%1:14:02:: | definition=a connected series of events or actions or developments | synonyms=course | examples=the government took a firm course; historians can only point out those lines for which evidence is available
11. sense_key=line%1:15:00:: | definition=a spatial location defined by a real or imaginary unidimensional extent
12. sense_key=line%1:25:01:: | definition=a slight depression in the smoothness of a surface | synonyms=wrinkle, furrow, crease, crinkle, seam | examples=his face has many lines; ironing gets rid of most wrinkles
13. sense_key=line%1:06:06:: | definition=a pipe used to transport liquids or gases | synonyms=pipeline | examples=a pipeline runs from the wells to the seaport
14. sense_key=line%1:06:03:: | definition=the road consisting of railroad track and roadbed | synonyms=railway line, rail line
15. sense_key=line%1:06:07:: | definition=a telephone connection | synonyms=telephone line, phone line, telephone circuit, subscriber line
16. sense_key=line%1:04:01:: | definition=acting in conformity | examples=in line with; he got out of line
17. sense_key=line%1:14:00:: | definition=the descendants of one individual | synonyms=lineage, line of descent, descent, bloodline, blood, pedigree | examples=his entire lineage has been warriors
18. sense_key=line%1:06:00:: | definition=something (as a cord or rope) that is long and thin and flexible | examples=a washing line
19. sense_key=line%1:04:00:: | definition=the principal activity in your life that you do to earn money | synonyms=occupation, business, job, line of work | examples=he's not in my line of business
20. sense_key=line%1:15:01:: | definition=in games or sports; a mark indicating positions or bounds of the playing area
21. sense_key=line%1:10:05:: | definition=(often plural) a means of communication or access | synonyms=channel, communication channel | examples=it must go through official channels; lines of communication were set up between the two firms
22. sense_key=line%1:06:08:: | definition=a particular kind of product or merchandise | synonyms=product line, line of products, line of merchandise, business line, line of business | examples=a nice line of shoes
23. sense_key=line%1:06:05:: | definition=a commercial organization serving as a common carrier
24. sense_key=line%1:23:00:: | definition=space for one line of print (one column wide and 1/14 inch deep) used to measure advertising | synonyms=agate line
25. sense_key=line%1:21:00:: | definition=the maximum credit that a customer is allowed | synonyms=credit line, line of credit, bank line, personal credit line, personal line of credit
26. sense_key=line%1:10:03:: | definition=a succession of notes forming a distinctive sequence | synonyms=tune, melody, air, strain, melodic line, melodic phrase | examples=she was humming an air from Beethoven
27. sense_key=line%1:10:06:: | definition=persuasive but insincere talk that is usually intended to deceive or impress | examples=`let me show you my etchings' is a rather worn line; he has a smooth line but I didn't fall for it
28. sense_key=line%1:10:04:: | definition=a short personal letter | synonyms=note, short letter, billet | examples=drop me a line when you get there
29. sense_key=line%1:09:00:: | definition=a conceptual separation or distinction | synonyms=dividing line, demarcation, contrast | examples=there is a narrow line between sanity and insanity
30. sense_key=line%1:06:09:: | definition=mechanical system in a factory whereby an article is conveyed through sites at which successive operations are performed on it | synonyms=production line, assembly line

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a formation of people or things one beside another

    line%1:14:03:: · line.n.01

    • the line of soldiers advanced with their bayonets fixed
    • they were arrayed in line of battle
  2. 2

    a mark that is long relative to its width

    line%1:10:01:: · line.n.02

    • He drew a line on the chart
  3. 3

    a formation of people or things one behind another

    line%1:14:01:: · line.n.03

    • the line stretched clear around the corner
    • you must wait in a long line at the checkout counter
  4. 4

    a length (straight or curved) without breadth or thickness; the trace of a moving point

    line%1:25:00:: · line.n.04

    Selected
  5. 5

    text consisting of a row of words written across a page or computer screen

    line%1:10:02:: · line.n.05

    • the letter consisted of three short lines
    • there are six lines in every stanza
  6. 6

    a single frequency (or very narrow band) of radiation in a spectrum

    line%1:19:00:: · line.n.06

  7. 7

    a fortified position (especially one marking the most forward position of troops)

    line%1:15:02:: · line.n.07

    • they attacked the enemy's line
  8. 8

    a course of reasoning aimed at demonstrating a truth or falsehood; the methodical process of logical reasoning

    line%1:09:01:: · argumentation.n.02

    • I can't follow your line of reasoning

    Synonyms: argumentation, logical argument, argument, line of reasoning

  9. 9

    a conductor for transmitting electrical or optical signals or electric power

    line%1:06:01:: · cable.n.02

    Synonyms: cable, transmission line

  10. 10

    a connected series of events or actions or developments

    line%1:14:02:: · course.n.02

    • the government took a firm course
    • historians can only point out those lines for which evidence is available

    Synonyms: course

  11. 11

    a spatial location defined by a real or imaginary unidimensional extent

    line%1:15:00:: · line.n.11

  12. 12

    a slight depression in the smoothness of a surface

    line%1:25:01:: · wrinkle.n.01

    • his face has many lines
    • ironing gets rid of most wrinkles

    Synonyms: wrinkle, furrow, crease, crinkle, seam

  13. 13

    a pipe used to transport liquids or gases

    line%1:06:06:: · pipeline.n.02

    • a pipeline runs from the wells to the seaport

    Synonyms: pipeline

  14. 14

    the road consisting of railroad track and roadbed

    line%1:06:03:: · line.n.14

    Synonyms: railway line, rail line

  15. 15

    a telephone connection

    line%1:06:07:: · telephone_line.n.02

    Synonyms: telephone line, phone line, telephone circuit, subscriber line

  16. 16

    acting in conformity

    line%1:04:01:: · line.n.16

    • in line with
    • he got out of line
  17. 17

    the descendants of one individual

    line%1:14:00:: · lineage.n.01

    • his entire lineage has been warriors

    Synonyms: lineage, line of descent, descent, bloodline, blood, pedigree, ancestry, origin, parentage, stemma, stock

  18. 18

    something (as a cord or rope) that is long and thin and flexible

    line%1:06:00:: · line.n.18

    • a washing line
  19. 19

    the principal activity in your life that you do to earn money

    line%1:04:00:: · occupation.n.01

    • he's not in my line of business

    Synonyms: occupation, business, job, line of work

  20. 20

    in games or sports; a mark indicating positions or bounds of the playing area

    line%1:15:01:: · line.n.20

    Gold lexEN Gold Maru 2022 Gold Raganato
  21. 21

    (often plural) a means of communication or access

    line%1:10:05:: · channel.n.05

    • it must go through official channels
    • lines of communication were set up between the two firms

    Synonyms: channel, communication channel

  22. 22

    a particular kind of product or merchandise

    line%1:06:08:: · line.n.22

    • a nice line of shoes

    Synonyms: product line, line of products, line of merchandise, business line, line of business

  23. 23

    a commercial organization serving as a common carrier

    line%1:06:05:: · line.n.23

  24. 24

    space for one line of print (one column wide and 1/14 inch deep) used to measure advertising

    line%1:23:00:: · agate_line.n.01

    Synonyms: agate line

  25. 25

    the maximum credit that a customer is allowed

    line%1:21:00:: · credit_line.n.01

    Synonyms: credit line, line of credit, bank line, personal credit line, personal line of credit

  26. 26

    a succession of notes forming a distinctive sequence

    line%1:10:03:: · tune.n.01

    • she was humming an air from Beethoven

    Synonyms: tune, melody, air, strain, melodic line, melodic phrase

  27. 27

    persuasive but insincere talk that is usually intended to deceive or impress

    line%1:10:06:: · line.n.27

    • `let me show you my etchings' is a rather worn line
    • he has a smooth line but I didn't fall for it
  28. 28

    a short personal letter

    line%1:10:04:: · note.n.02

    • drop me a line when you get there

    Synonyms: note, short letter, billet

  29. 29

    a conceptual separation or distinction

    line%1:09:00:: · line.n.29

    • there is a narrow line between sanity and insanity

    Synonyms: dividing line, demarcation, contrast

  30. 30

    mechanical system in a factory whereby an article is conveyed through sites at which successive operations are performed on it

    line%1:06:09:: · production_line.n.01

    Synonyms: production line, assembly line

game Noun

Instance: semeval2013.d001.s015.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77).

In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes. However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77). In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the <t>game</t> was already won and victory escaped Tel Aviv for the first time in the season.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
    Selected
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

figure Noun

Instance: semeval2013.d002.s002.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Wall Street closes without momentum, slowed by a strengthening dollar

The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%.

According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: figure
Target surface form: figures
Context:
Wall Street closes without momentum, slowed by a strengthening dollar The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%. According to final closing <t>figures</t>, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points. The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Candidate senses:
1. sense_key=figure%1:10:00:: | definition=a diagram or picture illustrating textual material | synonyms=fig | examples=the area covered can be seen from Figure 2
2. sense_key=figure%1:08:00:: | definition=alternative names for the body of a human being | synonyms=human body, physical body, material body, soma, build, physique | examples=Leonardo studied the human body; he has a strong physique
3. sense_key=figure%1:23:00:: | definition=one of the elements that collectively form a system of numeration | synonyms=digit | examples=0 and 1 are digits
4. sense_key=figure%1:06:00:: | definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
5. sense_key=figure%1:18:00:: | definition=a well-known or notable person | synonyms=name, public figure | examples=they studied all the great names in the history of France; she is an important figure in modern music
6. sense_key=figure%1:25:00:: | definition=a combination of points and lines and planes that form a visible palpable shape
7. sense_key=figure%1:21:00:: | definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
8. sense_key=figure%1:07:00:: | definition=the impression produced by a person | examples=he cut a fine figure; a heroic figure
9. sense_key=figure%1:07:01:: | definition=the property possessed by a sum or total or indefinite quantity of units or individuals | synonyms=number | examples=he had a number of chores to do; the number of parameters is small
10. sense_key=figure%1:10:01:: | definition=language used in a figurative or nonliteral sense | synonyms=trope, figure of speech, image
11. sense_key=figure%1:09:00:: | definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground
12. sense_key=figure%1:06:01:: | definition=a decorative or artistic work | synonyms=design, pattern | examples=the coach had a design on the doors
13. sense_key=figure%1:04:00:: | definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  2. 2

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  3. 3

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  4. 4

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  5. 5

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  6. 6

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

    Selected
  7. 7

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
  8. 8

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  9. 9

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  11. 11

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

  12. 12

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  13. 13

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures