Verified run

allenai/Olmo-3.1-32B-Instruct

vllm-olmo-3.1-32b-fp8-h100-p001-lexen-v1-20260614

Rank
163
Accuracy lexEN v1 · WordNet fine
73.98%
Correct
3596 / 4861
Actual run cost
$0.120
Cost / M items
$24.76

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 73.98% 3596 / 4861 87.60% 4258 / 4861 83.79% 4073 / 4861
Maru 2022 (ALLamended) 73.19% 3558 / 4861 87.39% 4248 / 4861 83.36% 4052 / 4861
Raganato 2017 (original) 68.98% 3353 / 4861 85.48% 4155 / 4861 80.68% 3922 / 4861

Model

Display
allenai/Olmo-3.1-32B-Instruct
Requested
hosted_vllm/allenai/Olmo-3.1-32B-Instruct
Resolved
allenai/Olmo-3.1-32B-Instruct
Vendor
AllenAI
API provider
n/a
Hosting
self_hosted
Source
open_source
License
apache-2.0
Reasoning
n/a
Model URL
https://huggingface.co/allenai/Olmo-3.1-32B-Instruct
Endpoint
http://localhost:8000/v1
Resolved counts
allenai/Olmo-3.1-32B-Instruct: 4885
HF revision
ac0587e4a7744a551c059d8cd17ba220bc940dae
Quantization
fp8
Inference engine
vllm
Engine version
0.22.1
Container image
vllm/vllm-openai:v0.22.1
Serve command
exec vllm serve allenai/Olmo-3.1-32B-Instruct --port 8000 --served-model-name allenai/Olmo-3.1-32B-Instruct --max-model-len 8192 --gpu-memory-utilization 0.90 --quantization fp8 --revision ac0587e4a7744a551c059d8cd17ba220bc940dae

Reproducibility

Created
2026-06-14T17:48:27.265217+00:00
Run schema
sensebench-run-v2
Commit
n/a
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p001
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4885
Total tokens
3,054,864
Tokens / item
628.4
Total cost
$0.120
Cost / M items
$24.76
Cost source
machine_time_estimate
Elapsed
3.14m
Success items
4,848
Monosemous
0
No candidates
0
No valid vote
13
Invalid votes
13
Transport errors
0

Machine & Timing

GPU
NVIDIA H100 80GB HBM3
VRAM / GPU
81,559 MiB
Driver
595.71.05
CUDA
13.2
CPU
AMD EPYC 7R13 Processor (192 cores)
RAM
1,999.9 GiB
Platform
Linux-6.17.0-1017-aws-x86_64-with-glibc2.35
Provider
vast.ai (40919268)
Hourly rate
$2.30/h
Benchmark time
3.14m
Machine-hours / 1M items
10.8 h/M
Concurrency
128

Benchmark time covers only the per-item evaluation loop on this machine, excluding model and asset loading.

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
2,048
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.120. Cost estimate source: machine_time_estimate. Cost is estimated from machine time multiplied by the recorded hourly rate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 3,015,784 n/a n/a
Input cached n/a n/a n/a
Output 39,080 n/a n/a
Reasoning output n/a included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 53.90% 428 794
Candidate Count 2 89.12% 762 855
Candidate Count 3-5 79.28% 1542 1945
Candidate Count 6-10 68.19% 864 1267
POS ADJ 80.58% 531 659
POS ADV 63.59% 124 195
POS NOUN 78.01% 2260 2897
POS VERB 61.35% 681 1110
Source Dataset semeval2013 76.58% 873 1140
Source Dataset semeval2015 76.32% 564 739
Source Dataset senseval2 73.48% 1197 1629
Source Dataset senseval3 71.10% 962 1353

Worst-Bucket Examples

hall Noun

Instance: semeval2013.d000.s024.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

This is clearly a game where a new economic hegemony is being developed, said Ulate, who also serves as the regional Mexico and Central America climate change adviser for Conservation International.

Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best.

The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning.

Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India.

The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding issues before the heads of government arrive to strike a deal.

High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's halls to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week.

The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and draft proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: hall
Target surface form: halls
Context:
This is clearly a game where a new economic hegemony is being developed, said Ulate, who also serves as the regional Mexico and Central America climate change adviser for Conservation International. Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best. The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning. Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India. The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding issues before the heads of government arrive to strike a deal. High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's <t>halls</t> to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week. The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and draft proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge.

Candidate senses:
1. sense_key=hall%1:06:03:: | definition=an interior passage or corridor onto which rooms open | synonyms=hallway | examples=the elevators were at the end of the hall
2. sense_key=hall%1:06:05:: | definition=a large entrance or reception room or area | synonyms=anteroom, antechamber, entrance hall, foyer, lobby, vestibule
3. sense_key=hall%1:06:02:: | definition=a large room for gatherings or entertainment | examples=lecture hall; pool hall
4. sense_key=hall%1:06:04:: | definition=a college or university building containing living quarters for students | synonyms=dormitory, dorm, residence hall, student residence
5. sense_key=hall%1:06:06:: | definition=the large room of a manor or castle | synonyms=manor hall
6. sense_key=hall%1:18:04:: | definition=English writer whose novel about a lesbian relationship was banned in Britain for many years (1883-1943) | synonyms=Radclyffe Hall, Marguerite Radclyffe Hall
7. sense_key=hall%1:18:03:: | definition=United States child psychologist whose theories of child psychology strongly influenced educational psychology (1844-1924) | synonyms=G. Stanley Hall, Granville Stanley Hall
8. sense_key=hall%1:18:02:: | definition=United States chemist who developed an economical method of producing aluminum from bauxite (1863-1914) | synonyms=Charles Martin Hall
9. sense_key=hall%1:18:01:: | definition=United States explorer who led three expeditions to the Arctic (1821-1871) | synonyms=Charles Francis Hall
10. sense_key=hall%1:18:00:: | definition=United States astronomer who discovered Phobos and Deimos (the two satellites of Mars) (1829-1907) | synonyms=Asaph Hall
11. sense_key=hall%1:06:07:: | definition=a large and imposing house | synonyms=mansion, mansion house, manse, residence
12. sense_key=hall%1:06:08:: | definition=a large building used by a college or university for teaching or research | examples=halls of learning
13. sense_key=hall%1:06:01:: | definition=a large building for meetings or entertainment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an interior passage or corridor onto which rooms open

    hall%1:06:03:: · hallway.n.01

    • the elevators were at the end of the hall

    Synonyms: hallway

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a large entrance or reception room or area

    hall%1:06:05:: · anteroom.n.01

    Synonyms: anteroom, antechamber, entrance hall, foyer, lobby, vestibule

    Gold lexEN Gold Maru 2022
  3. 3

    a large room for gatherings or entertainment

    hall%1:06:02:: · hall.n.03

    • lecture hall
    • pool hall
    Gold lexEN Gold Maru 2022
  4. 4

    a college or university building containing living quarters for students

    hall%1:06:04:: · dormitory.n.01

    Synonyms: dormitory, dorm, residence hall, student residence

  5. 5

    the large room of a manor or castle

    hall%1:06:06:: · manor_hall.n.01

    Synonyms: manor hall

  6. 6

    English writer whose novel about a lesbian relationship was banned in Britain for many years (1883-1943)

    hall%1:18:04:: · hall.n.06

    Synonyms: Radclyffe Hall, Marguerite Radclyffe Hall

  7. 7

    United States child psychologist whose theories of child psychology strongly influenced educational psychology (1844-1924)

    hall%1:18:03:: · hall.n.07

    Synonyms: G. Stanley Hall, Granville Stanley Hall

  8. 8

    United States chemist who developed an economical method of producing aluminum from bauxite (1863-1914)

    hall%1:18:02:: · hall.n.08

    Synonyms: Charles Martin Hall

  9. 9

    United States explorer who led three expeditions to the Arctic (1821-1871)

    hall%1:18:01:: · hall.n.09

    Synonyms: Charles Francis Hall

  10. 10

    United States astronomer who discovered Phobos and Deimos (the two satellites of Mars) (1829-1907)

    hall%1:18:00:: · hall.n.10

    Synonyms: Asaph Hall

  11. 11

    a large and imposing house

    hall%1:06:07:: · mansion.n.02

    Synonyms: mansion, mansion house, manse, residence

  12. 12

    a large building used by a college or university for teaching or research

    hall%1:06:08:: · hall.n.12

    • halls of learning
  13. 13

    a large building for meetings or entertainment

    hall%1:06:01:: · hall.n.13

    Selected

game Noun

Instance: semeval2013.d001.s004.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Baskonia gives away a victory in Israel

Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group.

The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph.

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Baskonia gives away a victory in Israel Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group. The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory. Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph. The <t>game</t> started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d001.s009.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the <t>game</t>, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d001.s009.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the <t>game</t>. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

line Noun

Instance: semeval2013.d001.s014.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77).

In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: line
Target surface form: line
Context:
But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game. Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes. However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point <t>line</t> (70-77). In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Candidate senses:
1. sense_key=line%1:14:03:: | definition=a formation of people or things one beside another | examples=the line of soldiers advanced with their bayonets fixed; they were arrayed in line of battle
2. sense_key=line%1:10:01:: | definition=a mark that is long relative to its width | examples=He drew a line on the chart
3. sense_key=line%1:14:01:: | definition=a formation of people or things one behind another | examples=the line stretched clear around the corner; you must wait in a long line at the checkout counter
4. sense_key=line%1:25:00:: | definition=a length (straight or curved) without breadth or thickness; the trace of a moving point
5. sense_key=line%1:10:02:: | definition=text consisting of a row of words written across a page or computer screen | examples=the letter consisted of three short lines; there are six lines in every stanza
6. sense_key=line%1:19:00:: | definition=a single frequency (or very narrow band) of radiation in a spectrum
7. sense_key=line%1:15:02:: | definition=a fortified position (especially one marking the most forward position of troops) | examples=they attacked the enemy's line
8. sense_key=line%1:09:01:: | definition=a course of reasoning aimed at demonstrating a truth or falsehood; the methodical process of logical reasoning | synonyms=argumentation, logical argument, argument, line of reasoning | examples=I can't follow your line of reasoning
9. sense_key=line%1:06:01:: | definition=a conductor for transmitting electrical or optical signals or electric power | synonyms=cable, transmission line
10. sense_key=line%1:14:02:: | definition=a connected series of events or actions or developments | synonyms=course | examples=the government took a firm course; historians can only point out those lines for which evidence is available
11. sense_key=line%1:15:00:: | definition=a spatial location defined by a real or imaginary unidimensional extent
12. sense_key=line%1:25:01:: | definition=a slight depression in the smoothness of a surface | synonyms=wrinkle, furrow, crease, crinkle, seam | examples=his face has many lines; ironing gets rid of most wrinkles
13. sense_key=line%1:06:06:: | definition=a pipe used to transport liquids or gases | synonyms=pipeline | examples=a pipeline runs from the wells to the seaport
14. sense_key=line%1:06:03:: | definition=the road consisting of railroad track and roadbed | synonyms=railway line, rail line
15. sense_key=line%1:06:07:: | definition=a telephone connection | synonyms=telephone line, phone line, telephone circuit, subscriber line
16. sense_key=line%1:04:01:: | definition=acting in conformity | examples=in line with; he got out of line
17. sense_key=line%1:14:00:: | definition=the descendants of one individual | synonyms=lineage, line of descent, descent, bloodline, blood, pedigree | examples=his entire lineage has been warriors
18. sense_key=line%1:06:00:: | definition=something (as a cord or rope) that is long and thin and flexible | examples=a washing line
19. sense_key=line%1:04:00:: | definition=the principal activity in your life that you do to earn money | synonyms=occupation, business, job, line of work | examples=he's not in my line of business
20. sense_key=line%1:15:01:: | definition=in games or sports; a mark indicating positions or bounds of the playing area
21. sense_key=line%1:10:05:: | definition=(often plural) a means of communication or access | synonyms=channel, communication channel | examples=it must go through official channels; lines of communication were set up between the two firms
22. sense_key=line%1:06:08:: | definition=a particular kind of product or merchandise | synonyms=product line, line of products, line of merchandise, business line, line of business | examples=a nice line of shoes
23. sense_key=line%1:06:05:: | definition=a commercial organization serving as a common carrier
24. sense_key=line%1:23:00:: | definition=space for one line of print (one column wide and 1/14 inch deep) used to measure advertising | synonyms=agate line
25. sense_key=line%1:21:00:: | definition=the maximum credit that a customer is allowed | synonyms=credit line, line of credit, bank line, personal credit line, personal line of credit
26. sense_key=line%1:10:03:: | definition=a succession of notes forming a distinctive sequence | synonyms=tune, melody, air, strain, melodic line, melodic phrase | examples=she was humming an air from Beethoven
27. sense_key=line%1:10:06:: | definition=persuasive but insincere talk that is usually intended to deceive or impress | examples=`let me show you my etchings' is a rather worn line; he has a smooth line but I didn't fall for it
28. sense_key=line%1:10:04:: | definition=a short personal letter | synonyms=note, short letter, billet | examples=drop me a line when you get there
29. sense_key=line%1:09:00:: | definition=a conceptual separation or distinction | synonyms=dividing line, demarcation, contrast | examples=there is a narrow line between sanity and insanity
30. sense_key=line%1:06:09:: | definition=mechanical system in a factory whereby an article is conveyed through sites at which successive operations are performed on it | synonyms=production line, assembly line

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a formation of people or things one beside another

    line%1:14:03:: · line.n.01

    • the line of soldiers advanced with their bayonets fixed
    • they were arrayed in line of battle
  2. 2

    a mark that is long relative to its width

    line%1:10:01:: · line.n.02

    • He drew a line on the chart
  3. 3

    a formation of people or things one behind another

    line%1:14:01:: · line.n.03

    • the line stretched clear around the corner
    • you must wait in a long line at the checkout counter
    Selected
  4. 4

    a length (straight or curved) without breadth or thickness; the trace of a moving point

    line%1:25:00:: · line.n.04

  5. 5

    text consisting of a row of words written across a page or computer screen

    line%1:10:02:: · line.n.05

    • the letter consisted of three short lines
    • there are six lines in every stanza
  6. 6

    a single frequency (or very narrow band) of radiation in a spectrum

    line%1:19:00:: · line.n.06

  7. 7

    a fortified position (especially one marking the most forward position of troops)

    line%1:15:02:: · line.n.07

    • they attacked the enemy's line
  8. 8

    a course of reasoning aimed at demonstrating a truth or falsehood; the methodical process of logical reasoning

    line%1:09:01:: · argumentation.n.02

    • I can't follow your line of reasoning

    Synonyms: argumentation, logical argument, argument, line of reasoning

  9. 9

    a conductor for transmitting electrical or optical signals or electric power

    line%1:06:01:: · cable.n.02

    Synonyms: cable, transmission line

  10. 10

    a connected series of events or actions or developments

    line%1:14:02:: · course.n.02

    • the government took a firm course
    • historians can only point out those lines for which evidence is available

    Synonyms: course

  11. 11

    a spatial location defined by a real or imaginary unidimensional extent

    line%1:15:00:: · line.n.11

  12. 12

    a slight depression in the smoothness of a surface

    line%1:25:01:: · wrinkle.n.01

    • his face has many lines
    • ironing gets rid of most wrinkles

    Synonyms: wrinkle, furrow, crease, crinkle, seam

  13. 13

    a pipe used to transport liquids or gases

    line%1:06:06:: · pipeline.n.02

    • a pipeline runs from the wells to the seaport

    Synonyms: pipeline

  14. 14

    the road consisting of railroad track and roadbed

    line%1:06:03:: · line.n.14

    Synonyms: railway line, rail line

  15. 15

    a telephone connection

    line%1:06:07:: · telephone_line.n.02

    Synonyms: telephone line, phone line, telephone circuit, subscriber line

  16. 16

    acting in conformity

    line%1:04:01:: · line.n.16

    • in line with
    • he got out of line
  17. 17

    the descendants of one individual

    line%1:14:00:: · lineage.n.01

    • his entire lineage has been warriors

    Synonyms: lineage, line of descent, descent, bloodline, blood, pedigree, ancestry, origin, parentage, stemma, stock

  18. 18

    something (as a cord or rope) that is long and thin and flexible

    line%1:06:00:: · line.n.18

    • a washing line
  19. 19

    the principal activity in your life that you do to earn money

    line%1:04:00:: · occupation.n.01

    • he's not in my line of business

    Synonyms: occupation, business, job, line of work

  20. 20

    in games or sports; a mark indicating positions or bounds of the playing area

    line%1:15:01:: · line.n.20

    Gold lexEN Gold Maru 2022 Gold Raganato
  21. 21

    (often plural) a means of communication or access

    line%1:10:05:: · channel.n.05

    • it must go through official channels
    • lines of communication were set up between the two firms

    Synonyms: channel, communication channel

  22. 22

    a particular kind of product or merchandise

    line%1:06:08:: · line.n.22

    • a nice line of shoes

    Synonyms: product line, line of products, line of merchandise, business line, line of business

  23. 23

    a commercial organization serving as a common carrier

    line%1:06:05:: · line.n.23

  24. 24

    space for one line of print (one column wide and 1/14 inch deep) used to measure advertising

    line%1:23:00:: · agate_line.n.01

    Synonyms: agate line

  25. 25

    the maximum credit that a customer is allowed

    line%1:21:00:: · credit_line.n.01

    Synonyms: credit line, line of credit, bank line, personal credit line, personal line of credit

  26. 26

    a succession of notes forming a distinctive sequence

    line%1:10:03:: · tune.n.01

    • she was humming an air from Beethoven

    Synonyms: tune, melody, air, strain, melodic line, melodic phrase

  27. 27

    persuasive but insincere talk that is usually intended to deceive or impress

    line%1:10:06:: · line.n.27

    • `let me show you my etchings' is a rather worn line
    • he has a smooth line but I didn't fall for it
  28. 28

    a short personal letter

    line%1:10:04:: · note.n.02

    • drop me a line when you get there

    Synonyms: note, short letter, billet

  29. 29

    a conceptual separation or distinction

    line%1:09:00:: · line.n.29

    • there is a narrow line between sanity and insanity

    Synonyms: dividing line, demarcation, contrast

  30. 30

    mechanical system in a factory whereby an article is conveyed through sites at which successive operations are performed on it

    line%1:06:09:: · production_line.n.01

    Synonyms: production line, assembly line

game Noun

Instance: semeval2013.d001.s015.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77).

In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes. However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77). In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the <t>game</t> was already won and victory escaped Tel Aviv for the first time in the season.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

figure Noun

Instance: semeval2013.d002.s002.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Wall Street closes without momentum, slowed by a strengthening dollar

The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%.

According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: figure
Target surface form: figures
Context:
Wall Street closes without momentum, slowed by a strengthening dollar The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%. According to final closing <t>figures</t>, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points. The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Candidate senses:
1. sense_key=figure%1:10:00:: | definition=a diagram or picture illustrating textual material | synonyms=fig | examples=the area covered can be seen from Figure 2
2. sense_key=figure%1:08:00:: | definition=alternative names for the body of a human being | synonyms=human body, physical body, material body, soma, build, physique | examples=Leonardo studied the human body; he has a strong physique
3. sense_key=figure%1:23:00:: | definition=one of the elements that collectively form a system of numeration | synonyms=digit | examples=0 and 1 are digits
4. sense_key=figure%1:06:00:: | definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
5. sense_key=figure%1:18:00:: | definition=a well-known or notable person | synonyms=name, public figure | examples=they studied all the great names in the history of France; she is an important figure in modern music
6. sense_key=figure%1:25:00:: | definition=a combination of points and lines and planes that form a visible palpable shape
7. sense_key=figure%1:21:00:: | definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
8. sense_key=figure%1:07:00:: | definition=the impression produced by a person | examples=he cut a fine figure; a heroic figure
9. sense_key=figure%1:07:01:: | definition=the property possessed by a sum or total or indefinite quantity of units or individuals | synonyms=number | examples=he had a number of chores to do; the number of parameters is small
10. sense_key=figure%1:10:01:: | definition=language used in a figurative or nonliteral sense | synonyms=trope, figure of speech, image
11. sense_key=figure%1:09:00:: | definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground
12. sense_key=figure%1:06:01:: | definition=a decorative or artistic work | synonyms=design, pattern | examples=the coach had a design on the doors
13. sense_key=figure%1:04:00:: | definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  2. 2

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  3. 3

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  4. 4

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  5. 5

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  6. 6

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

  7. 7

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
    Selected
  8. 8

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  9. 9

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  11. 11

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

  12. 12

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  13. 13

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures

case Noun

Instance: semeval2013.d002.s005.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Wall Street closes without momentum, slowed by a strengthening dollar

The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%.

According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Frankly, the market is very calm, observes Mace Blicksilver of Marblehead Asset Management.

It remains within a narrow margin; trading volumes have become very weak, and I think that this will remain the case until the end of the year.

The trend was supported by the publication of better than expected economic indicators, which "have contributed to improving market opinion in relation to the robustness of the economic recovery", summarised Charles Schwab's analysts.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: case
Target surface form: case
Context:
Wall Street closes without momentum, slowed by a strengthening dollar The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%. According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points. The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points. Frankly, the market is very calm, observes Mace Blicksilver of Marblehead Asset Management. It remains within a narrow margin; trading volumes have become very weak, and I think that this will remain the <t>case</t> until the end of the year. The trend was supported by the publication of better than expected economic indicators, which "have contributed to improving market opinion in relation to the robustness of the economic recovery", summarised Charles Schwab's analysts.

Candidate senses:
1. sense_key=case%1:11:00:: | definition=an occurrence of something | synonyms=instance, example | examples=it was a case of bad judgment; another instance occurred yesterday
2. sense_key=case%1:26:00:: | definition=a special set of circumstances | synonyms=event | examples=in that event, the first possibility is excluded; it may rain in which case the picnic will be canceled
3. sense_key=case%1:04:00:: | definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | synonyms=lawsuit, suit, cause, causa | examples=the family brought suit against the landlord
4. sense_key=case%1:09:00:: | definition=the actual state of things | examples=that was not the case
5. sense_key=case%1:06:00:: | definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. sense_key=case%1:18:03:: | definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. sense_key=case%1:18:02:: | definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | synonyms=subject, guinea pig | examples=the subjects for this investigation were selected randomly; the cases that we studied were drawn from two different communities
8. sense_key=case%1:10:02:: | definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. sense_key=case%1:10:01:: | definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. sense_key=case%1:23:00:: | definition=the quantity contained in a case | synonyms=caseful
11. sense_key=case%1:10:00:: | definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence | synonyms=grammatical case
12. sense_key=case%1:26:02:: | definition=a specific state of mind that is temporary | examples=a case of the jitters
13. sense_key=case%1:18:04:: | definition=a person of a specified kind (usually with many eccentricities) | synonyms=character, eccentric, type | examples=a real character; a strange character
14. sense_key=case%1:10:03:: | definition=a specific size and style of type within a type family | synonyms=font, fount, typeface, face
15. sense_key=case%1:08:00:: | definition=an enveloping structure or covering enclosing an animal or plant organ or part | synonyms=sheath
16. sense_key=case%1:06:06:: | definition=the housing or outer covering of something | synonyms=shell, casing | examples=the clock has a walnut case
17. sense_key=case%1:06:07:: | definition=the enclosing frame around a door or window opening | synonyms=casing | examples=the casings had rotted away and had to be replaced
18. sense_key=case%1:06:03:: | definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | synonyms=compositor's case, typesetter's case | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. sense_key=case%1:06:02:: | definition=bed linen consisting of a cover for a pillow | synonyms=pillowcase, slip, pillow slip | examples=the burglar carried his loot in a pillowcase
20. sense_key=case%1:06:01:: | definition=a glass container used to store and display items in a shop or museum or home | synonyms=display case, showcase, vitrine

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

  2. 2

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

    Selected
  3. 3

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

  4. 4

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
    Gold lexEN Gold Maru 2022 Gold Raganato
  5. 5

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  6. 6

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  7. 7

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  8. 8

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
  9. 9

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  10. 10

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  11. 11

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  12. 12

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
  13. 13

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  14. 14

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

  15. 15

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  16. 16

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  17. 17

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  18. 18

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  19. 19

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  20. 20

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine

ground Noun

Instance: semeval2013.d002.s010.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

It remains within a narrow margin; trading volumes have become very weak, and I think that this will remain the case until the end of the year.

The trend was supported by the publication of better than expected economic indicators, which "have contributed to improving market opinion in relation to the robustness of the economic recovery", summarised Charles Schwab's analysts.

In the United States, retail sales have increased by 1.3% in November, for the second month in a row, and far more than predicted.

Moreover, the confidence of American consumers has clearly bounced back in December, to 73.4 against 67.4 the previous month, according to preliminary estimates from Michigan University's index.

The indices have, however, been slowed by a renewed rise of the dollar, to a new two-month high against the Euro, which "puts downward pressure on the sectors that are sensitive to the economic situation", explained Owen Fitzpatrick from Deutsche Bank.

Technology securities have thereby lost some ground.

The bond market has fallen.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: ground
Target surface form: ground
Context:
It remains within a narrow margin; trading volumes have become very weak, and I think that this will remain the case until the end of the year. The trend was supported by the publication of better than expected economic indicators, which "have contributed to improving market opinion in relation to the robustness of the economic recovery", summarised Charles Schwab's analysts. In the United States, retail sales have increased by 1.3% in November, for the second month in a row, and far more than predicted. Moreover, the confidence of American consumers has clearly bounced back in December, to 73.4 against 67.4 the previous month, according to preliminary estimates from Michigan University's index. The indices have, however, been slowed by a renewed rise of the dollar, to a new two-month high against the Euro, which "puts downward pressure on the sectors that are sensitive to the economic situation", explained Owen Fitzpatrick from Deutsche Bank. Technology securities have thereby lost some <t>ground</t>. The bond market has fallen.

Candidate senses:
1. sense_key=ground%1:17:00:: | definition=the solid part of the earth's surface | synonyms=land, dry land, earth, solid ground, terra firma | examples=the plane turned away from the sea and moved back over land; the earth shook for several minutes
2. sense_key=ground%1:16:00:: | definition=a rational motive for a belief or action | synonyms=reason | examples=the reason that war was declared; the grounds for their declaration
3. sense_key=ground%1:27:00:: | definition=the loose soft material that makes up a large part of the land surface | synonyms=earth | examples=they dug into the earth outside the church
4. sense_key=ground%1:24:00:: | definition=a relation that provides the foundation for something | synonyms=footing, basis | examples=they were on a friendly footing; he worked on an interim basis
5. sense_key=ground%1:15:00:: | definition=a position to be won or defended in battle (or as if in battle) | examples=they gained ground step by step; they fought to regain the lost ground
6. sense_key=ground%1:09:00:: | definition=the part of a scene (or picture) that lies behind objects in the foreground | synonyms=background | examples=he posed her against a background of rolling hills
7. sense_key=ground%1:17:01:: | definition=material in the top layer of the surface of the earth in which plants can grow (especially with reference to its quality or use) | synonyms=land, soil | examples=the land had never been plowed; good agricultural soil
8. sense_key=ground%1:09:01:: | definition=a relatively homogeneous percept extending back of the figure on which attention is focused
9. sense_key=ground%1:06:02:: | definition=a connection between an electrical device and a large conducting body, such as the earth (which is taken to be at zero voltage) | synonyms=earth
10. sense_key=ground%1:06:01:: | definition=(art) the surface (as a wall or canvas) prepared to take the paint for a painting
11. sense_key=ground%1:06:00:: | definition=the first or preliminary coat of paint or size applied to a surface | synonyms=flat coat, primer, priming, primer coat, priming coat, undercoat

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the solid part of the earth's surface

    ground%1:17:00:: · land.n.04

    • the plane turned away from the sea and moved back over land
    • the earth shook for several minutes

    Synonyms: land, dry land, earth, solid ground, terra firma

  2. 2

    a rational motive for a belief or action

    ground%1:16:00:: · reason.n.01

    • the reason that war was declared
    • the grounds for their declaration

    Synonyms: reason

  3. 3

    the loose soft material that makes up a large part of the land surface

    ground%1:27:00:: · earth.n.02

    • they dug into the earth outside the church

    Synonyms: earth

  4. 4

    a relation that provides the foundation for something

    ground%1:24:00:: · footing.n.02

    • they were on a friendly footing
    • he worked on an interim basis

    Synonyms: footing, basis

    Gold Raganato
  5. 5

    a position to be won or defended in battle (or as if in battle)

    ground%1:15:00:: · ground.n.05

    • they gained ground step by step
    • they fought to regain the lost ground
    Gold lexEN Gold Maru 2022
  6. 6

    the part of a scene (or picture) that lies behind objects in the foreground

    ground%1:09:00:: · background.n.02

    • he posed her against a background of rolling hills

    Synonyms: background

  7. 7

    material in the top layer of the surface of the earth in which plants can grow (especially with reference to its quality or use)

    ground%1:17:01:: · land.n.02

    • the land had never been plowed
    • good agricultural soil

    Synonyms: land, soil

  8. 8

    a relatively homogeneous percept extending back of the figure on which attention is focused

    ground%1:09:01:: · ground.n.08

    Selected
  9. 9

    a connection between an electrical device and a large conducting body, such as the earth (which is taken to be at zero voltage)

    ground%1:06:02:: · ground.n.09

    Synonyms: earth

  10. 10

    (art) the surface (as a wall or canvas) prepared to take the paint for a painting

    ground%1:06:01:: · ground.n.10

  11. 11

    the first or preliminary coat of paint or size applied to a surface

    ground%1:06:00:: · flat_coat.n.01

    Synonyms: flat coat, primer, priming, primer coat, priming coat, undercoat

case Noun

Instance: semeval2013.d003.s011.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Two American companies reached deals for fields auctioned in June.

The meager representation of American oil giants in Iraq's opening oil industry surprised analysts.

Iraq finally opened its doors after six years of war, and instead of U.S. companies, you have Asians and Europeans leading the way, said Ruba Husari, the editor of Iraq Oil Forum, an online news outlet.

It will be a long time before anything else will be on offer in Iraq.

Concerns over security, underscored by massive coordinated bombings Tuesday, and political instability as the U.S. military withdraws, likely kept American oil companies from venturing more forcefully in Iraq, which has the world's third-largest proven crude reserves, analysts said.

U.S. firms were in some cases at a disadvantage because rivals, particularly the Chinese and other government controlled energy firms, have markedly lower labor costs and are more prone to take risks because they don't respond to shareholders.

Exxon-Mobil and Occidental Petroleum Inc. were the only American companies that reached deals with the ministry.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: case
Target surface form: cases
Context:
Two American companies reached deals for fields auctioned in June. The meager representation of American oil giants in Iraq's opening oil industry surprised analysts. Iraq finally opened its doors after six years of war, and instead of U.S. companies, you have Asians and Europeans leading the way, said Ruba Husari, the editor of Iraq Oil Forum, an online news outlet. It will be a long time before anything else will be on offer in Iraq. Concerns over security, underscored by massive coordinated bombings Tuesday, and political instability as the U.S. military withdraws, likely kept American oil companies from venturing more forcefully in Iraq, which has the world's third-largest proven crude reserves, analysts said. U.S. firms were in some <t>cases</t> at a disadvantage because rivals, particularly the Chinese and other government controlled energy firms, have markedly lower labor costs and are more prone to take risks because they don't respond to shareholders. Exxon-Mobil and Occidental Petroleum Inc. were the only American companies that reached deals with the ministry.

Candidate senses:
1. sense_key=case%1:11:00:: | definition=an occurrence of something | synonyms=instance, example | examples=it was a case of bad judgment; another instance occurred yesterday
2. sense_key=case%1:26:00:: | definition=a special set of circumstances | synonyms=event | examples=in that event, the first possibility is excluded; it may rain in which case the picnic will be canceled
3. sense_key=case%1:04:00:: | definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | synonyms=lawsuit, suit, cause, causa | examples=the family brought suit against the landlord
4. sense_key=case%1:09:00:: | definition=the actual state of things | examples=that was not the case
5. sense_key=case%1:06:00:: | definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. sense_key=case%1:18:03:: | definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. sense_key=case%1:18:02:: | definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | synonyms=subject, guinea pig | examples=the subjects for this investigation were selected randomly; the cases that we studied were drawn from two different communities
8. sense_key=case%1:10:02:: | definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. sense_key=case%1:10:01:: | definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. sense_key=case%1:23:00:: | definition=the quantity contained in a case | synonyms=caseful
11. sense_key=case%1:10:00:: | definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence | synonyms=grammatical case
12. sense_key=case%1:26:02:: | definition=a specific state of mind that is temporary | examples=a case of the jitters
13. sense_key=case%1:18:04:: | definition=a person of a specified kind (usually with many eccentricities) | synonyms=character, eccentric, type | examples=a real character; a strange character
14. sense_key=case%1:10:03:: | definition=a specific size and style of type within a type family | synonyms=font, fount, typeface, face
15. sense_key=case%1:08:00:: | definition=an enveloping structure or covering enclosing an animal or plant organ or part | synonyms=sheath
16. sense_key=case%1:06:06:: | definition=the housing or outer covering of something | synonyms=shell, casing | examples=the clock has a walnut case
17. sense_key=case%1:06:07:: | definition=the enclosing frame around a door or window opening | synonyms=casing | examples=the casings had rotted away and had to be replaced
18. sense_key=case%1:06:03:: | definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | synonyms=compositor's case, typesetter's case | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. sense_key=case%1:06:02:: | definition=bed linen consisting of a cover for a pillow | synonyms=pillowcase, slip, pillow slip | examples=the burglar carried his loot in a pillowcase
20. sense_key=case%1:06:01:: | definition=a glass container used to store and display items in a shop or museum or home | synonyms=display case, showcase, vitrine

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

    Selected
  3. 3

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

  4. 4

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
  5. 5

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  6. 6

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  7. 7

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  8. 8

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
  9. 9

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  10. 10

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  11. 11

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  12. 12

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
  13. 13

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  14. 14

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

  15. 15

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  16. 16

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  17. 17

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  18. 18

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  19. 19

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  20. 20

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine

field Noun

Instance: semeval2013.d003.s018.t008 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Major U.S. firms such as Chevron and ConocoPhillips, which have cultivated close ties with the Iraqi Oil Ministry and have provided technical advice in recent years, walked away empty-handed.

Russian companies Lukoil and Gazprom were the top stakeholders in two of the contracts awarded this weekend.

State-owned China National Petroleum Corporation bid on more contracts than any other company and walked away with large stakes in contracts for two major fields.

We all know that China is on track to become a major economic as well as technological power, Oil Ministry spokesman Assam Jihad said.

We feel confident that the Chinese company will be on par with its competitors and will deliver on its commitments towards Iraq.

Companies pre-selected to submit bids made offers that were then compared to the per barrel fee the ministry was willing to pay for boosting output above current levels at each field.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: field
Target surface form: field
Context:
Major U.S. firms such as Chevron and ConocoPhillips, which have cultivated close ties with the Iraqi Oil Ministry and have provided technical advice in recent years, walked away empty-handed. Russian companies Lukoil and Gazprom were the top stakeholders in two of the contracts awarded this weekend. State-owned China National Petroleum Corporation bid on more contracts than any other company and walked away with large stakes in contracts for two major fields. We all know that China is on track to become a major economic as well as technological power, Oil Ministry spokesman Assam Jihad said. We feel confident that the Chinese company will be on par with its competitors and will deliver on its commitments towards Iraq. Companies pre-selected to submit bids made offers that were then compared to the per barrel fee the ministry was willing to pay for boosting output above current levels at each <t>field</t>.

Candidate senses:
1. sense_key=field%1:15:00:: | definition=a piece of land cleared of trees and usually enclosed | examples=he planted a field of wheat
2. sense_key=field%1:15:04:: | definition=a region where a battle is being (or has been) fought | synonyms=battlefield, battleground, field of battle, field of honor | examples=they made a tour of Civil War battlefields
3. sense_key=field%1:15:01:: | definition=somewhere (away from a studio or office or library or laboratory) where practical work is done or data is collected | examples=anthropologists do much of their work in the field
4. sense_key=field%1:09:00:: | definition=a branch of knowledge | synonyms=discipline, subject, subject area, subject field, field of study, study | examples=in what discipline is his doctorate?; teachers should be well trained in their subject
5. sense_key=field%1:19:00:: | definition=the space around a radiating body within which its electromagnetic oscillations can exert force on another similar body not in contact with it | synonyms=field of force, force field
6. sense_key=field%1:04:00:: | definition=a particular kind of commercial enterprise | synonyms=field of operation, line of business | examples=they are outstanding in their field
7. sense_key=field%1:26:00:: | definition=a particular environment or walk of life | synonyms=sphere, domain, area, orbit, arena | examples=his social sphere is limited; it was a closed area of employment
8. sense_key=field%1:15:02:: | definition=a piece of land prepared for playing a game | synonyms=playing field, athletic field, playing area | examples=the home crowd cheered when Princeton took the field
9. sense_key=field%1:17:00:: | definition=extensive tract of level open land | synonyms=plain, champaign | examples=they emerged from the woods onto a vast open plain; he longed for the fields of his youth
10. sense_key=field%1:14:00:: | definition=(mathematics) a set of elements such that addition and multiplication are commutative and associative and multiplication is distributive over addition and there are two elements 0 and 1 | examples=the set of all rational numbers is a field
11. sense_key=field%1:15:03:: | definition=a region in which active military operations are in progress | synonyms=field of operations, theater, theater of operations, theatre, theatre of operations | examples=the army was in the field awaiting action; he served in the Vietnam theater for three years
12. sense_key=field%1:14:01:: | definition=all of the horses in a particular horse race
13. sense_key=field%1:14:02:: | definition=all the competitors in a particular contest or sporting event
14. sense_key=field%1:15:05:: | definition=a geographic region (land or sea) under which something valuable is found | examples=the diamond fields of South Africa
15. sense_key=field%1:14:03:: | definition=(computer science) a set of one or more adjacent characters comprising a unit of information
16. sense_key=field%1:09:01:: | definition=the area that is visible (as through an optical instrument) | synonyms=field of view
17. sense_key=field%1:06:00:: | definition=a place where planes take off and land | synonyms=airfield, landing field, flying field

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a piece of land cleared of trees and usually enclosed

    field%1:15:00:: · field.n.01

    • he planted a field of wheat
    Gold Maru 2022 Gold Raganato
  2. 2

    a region where a battle is being (or has been) fought

    field%1:15:04:: · battlefield.n.01

    • they made a tour of Civil War battlefields

    Synonyms: battlefield, battleground, field of battle, field of honor

  3. 3

    somewhere (away from a studio or office or library or laboratory) where practical work is done or data is collected

    field%1:15:01:: · field.n.03

    • anthropologists do much of their work in the field
  4. 4

    a branch of knowledge

    field%1:09:00:: · discipline.n.01

    • in what discipline is his doctorate?
    • teachers should be well trained in their subject

    Synonyms: discipline, subject, subject area, subject field, field of study, study, bailiwick

  5. 5

    the space around a radiating body within which its electromagnetic oscillations can exert force on another similar body not in contact with it

    field%1:19:00:: · field.n.05

    Synonyms: field of force, force field

  6. 6

    a particular kind of commercial enterprise

    field%1:04:00:: · field.n.06

    • they are outstanding in their field

    Synonyms: field of operation, line of business

  7. 7

    a particular environment or walk of life

    field%1:26:00:: · sphere.n.01

    • his social sphere is limited
    • it was a closed area of employment

    Synonyms: sphere, domain, area, orbit, arena

  8. 8

    a piece of land prepared for playing a game

    field%1:15:02:: · playing_field.n.02

    • the home crowd cheered when Princeton took the field

    Synonyms: playing field, athletic field, playing area

  9. 9

    extensive tract of level open land

    field%1:17:00:: · plain.n.01

    • they emerged from the woods onto a vast open plain
    • he longed for the fields of his youth

    Synonyms: plain, champaign

  10. 10

    (mathematics) a set of elements such that addition and multiplication are commutative and associative and multiplication is distributive over addition and there are two elements 0 and 1

    field%1:14:00:: · field.n.10

    • the set of all rational numbers is a field
  11. 11

    a region in which active military operations are in progress

    field%1:15:03:: · field.n.11

    • the army was in the field awaiting action
    • he served in the Vietnam theater for three years

    Synonyms: field of operations, theater, theater of operations, theatre, theatre of operations

  12. 12

    all of the horses in a particular horse race

    field%1:14:01:: · field.n.12

  13. 13

    all the competitors in a particular contest or sporting event

    field%1:14:02:: · field.n.13

  14. 14

    a geographic region (land or sea) under which something valuable is found

    field%1:15:05:: · field.n.14

    • the diamond fields of South Africa
    Gold lexEN
  15. 15

    (computer science) a set of one or more adjacent characters comprising a unit of information

    field%1:14:03:: · field.n.15

    Selected
  16. 16

    the area that is visible (as through an optical instrument)

    field%1:09:01:: · field.n.16

    Synonyms: field of view

  17. 17

    a place where planes take off and land

    field%1:06:00:: · airfield.n.01

    Synonyms: airfield, landing field, flying field

support Noun

Instance: semeval2013.d004.s000.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

US banks repay state support

The crisis-hit US major banks are breaking free from their state shackles.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: support
Target surface form: support
Context:
US banks repay state <t>support</t> The crisis-hit US major banks are breaking free from their state shackles.

Candidate senses:
1. sense_key=support%1:04:04:: | definition=the activity of providing for or maintaining by supplying with money or necessities | examples=his support kept the family together; they gave him emotional support during difficult times
2. sense_key=support%1:04:00:: | definition=aiding the cause or policy or interests of | examples=the president no longer has the support of his own party; they developed a scheme of mutual support
3. sense_key=support%1:09:00:: | definition=something providing immaterial assistance to a person or cause or interest | examples=the policy found little public support; his faith was all the support he needed
4. sense_key=support%1:04:03:: | definition=a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission | synonyms=reinforcement, reenforcement | examples=they called for artillery support
5. sense_key=support%1:04:02:: | definition=documentary validation | synonyms=documentation | examples=his documentation of the results was excellent; the strongest support for this view is the work of Jones
6. sense_key=support%1:21:00:: | definition=the financial means whereby one lives | synonyms=keep, livelihood, living, bread and butter, sustenance | examples=each child was expected to pay for their keep; he applied to the state for support
7. sense_key=support%1:06:01:: | definition=supporting structure that holds up or provides a foundation | examples=the statue stood on a marble support
8. sense_key=support%1:04:01:: | definition=the act of bearing the weight of or strengthening | synonyms=supporting | examples=he leaned against the wall for support
9. sense_key=support%1:10:01:: | definition=a musical part (vocal or instrumental) that supports or provides background for other musical parts | synonyms=accompaniment, musical accompaniment, backup
10. sense_key=support%1:06:00:: | definition=any device that bears the weight of another thing | examples=there was no place to attach supports for a shelf
11. sense_key=support%1:21:01:: | definition=financial resources provided to make some project possible | synonyms=financial support, funding, backing, financial backing | examples=the foundation provided support for the experiment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the activity of providing for or maintaining by supplying with money or necessities

    support%1:04:04:: · support.n.01

    • his support kept the family together
    • they gave him emotional support during difficult times
  2. 2

    aiding the cause or policy or interests of

    support%1:04:00:: · support.n.02

    • the president no longer has the support of his own party
    • they developed a scheme of mutual support
    Selected
  3. 3

    something providing immaterial assistance to a person or cause or interest

    support%1:09:00:: · support.n.03

    • the policy found little public support
    • his faith was all the support he needed
  4. 4

    a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission

    support%1:04:03:: · support.n.04

    • they called for artillery support

    Synonyms: reinforcement, reenforcement

  5. 5

    documentary validation

    support%1:04:02:: · documentation.n.03

    • his documentation of the results was excellent
    • the strongest support for this view is the work of Jones

    Synonyms: documentation

  6. 6

    the financial means whereby one lives

    support%1:21:00:: · support.n.06

    • each child was expected to pay for their keep
    • he applied to the state for support

    Synonyms: keep, livelihood, living, bread and butter, sustenance

  7. 7

    supporting structure that holds up or provides a foundation

    support%1:06:01:: · support.n.07

    • the statue stood on a marble support
  8. 8

    the act of bearing the weight of or strengthening

    support%1:04:01:: · support.n.08

    • he leaned against the wall for support

    Synonyms: supporting

  9. 9

    a musical part (vocal or instrumental) that supports or provides background for other musical parts

    support%1:10:01:: · accompaniment.n.02

    Synonyms: accompaniment, musical accompaniment, backup

  10. 10

    any device that bears the weight of another thing

    support%1:06:00:: · support.n.10

    • there was no place to attach supports for a shelf
  11. 11

    financial resources provided to make some project possible

    support%1:21:01:: · support.n.11

    • the foundation provided support for the experiment

    Synonyms: financial support, funding, backing, financial backing

    Gold lexEN Gold Maru 2022 Gold Raganato