Verified run

zai-org/GLM-4-9B-0414

vllm-glm-4-9b-bf16-a100-p001-lexen-v1-20260614

Rank
146
Accuracy lexEN v1 · WordNet fine
79.78%
Correct
3878 / 4861
Actual run cost
$0.0659
Cost / M items
$13.56

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 79.78% 3878 / 4861 90.72% 4410 / 4861 87.43% 4250 / 4861
Maru 2022 (ALLamended) 78.93% 3837 / 4861 90.58% 4403 / 4861 87.08% 4233 / 4861
Raganato 2017 (original) 74.45% 3619 / 4861 88.52% 4303 / 4861 84.30% 4098 / 4861

Model

Display
zai-org/GLM-4-9B-0414
Requested
hosted_vllm/zai-org/GLM-4-9B-0414
Resolved
zai-org/GLM-4-9B-0414
Vendor
Z.ai
API provider
n/a
Hosting
self_hosted
Source
open_source
License
MIT
Reasoning
n/a
Model URL
https://huggingface.co/zai-org/GLM-4-9B-0414
Endpoint
http://localhost:8000/v1
Resolved counts
zai-org/GLM-4-9B-0414: 4863
HF revision
645b8482494e31b6b752272bf7f7f273ef0f3caf
Quantization
bf16
Inference engine
vllm
Engine version
0.22.1
Container image
vllm/vllm-openai:v0.22.1
Serve command
exec vllm serve zai-org/GLM-4-9B-0414 --port 8000 --served-model-name zai-org/GLM-4-9B-0414 --max-model-len 8192 --gpu-memory-utilization 0.90 --trust-remote-code --revision 645b8482494e31b6b752272bf7f7f273ef0f3caf

Reproducibility

Created
2026-06-14T13:12:11.870521+00:00
Run schema
sensebench-run-v2
Commit
n/a
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p001
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4863
Total tokens
3,019,430
Tokens / item
621.2
Total cost
$0.0659
Cost / M items
$13.56
Cost source
machine_time_estimate
Elapsed
3.62m
Success items
4,859
Monosemous
0
No candidates
0
No valid vote
2
Invalid votes
2
Transport errors
0

Machine & Timing

GPU
NVIDIA A100-SXM4-80GB
VRAM / GPU
81,920 MiB
Driver
570.195.03
CUDA
13.0
CPU
AMD EPYC 7513 32-Core Processor (128 cores)
RAM
1,385.7 GiB
Platform
Linux-5.15.0-160-generic-x86_64-with-glibc2.35
Provider
vast.ai (40919271)
Hourly rate
$1.09/h
Benchmark time
3.62m
Machine-hours / 1M items
12.4 h/M
Concurrency
96

Benchmark time covers only the per-item evaluation loop on this machine, excluding model and asset loading.

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
2,048
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.0659. Cost estimate source: machine_time_estimate. Cost is estimated from machine time multiplied by the recorded hourly rate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 2,971,955 n/a n/a
Input cached n/a n/a n/a
Output 47,475 n/a n/a
Reasoning output n/a included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 67.38% 535 794
Candidate Count 2 90.41% 773 855
Candidate Count 3-5 83.14% 1617 1945
Candidate Count 6-10 75.22% 953 1267
POS ADJ 86.19% 568 659
POS ADV 69.74% 136 195
POS NOUN 83.40% 2416 2897
POS VERB 68.29% 758 1110
Source Dataset semeval2013 83.60% 953 1140
Source Dataset semeval2015 79.03% 584 739
Source Dataset senseval2 79.01% 1287 1629
Source Dataset senseval3 77.90% 1054 1353

Worst-Bucket Examples

hall Noun

Instance: semeval2013.d000.s024.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

This is clearly a game where a new economic hegemony is being developed, said Ulate, who also serves as the regional Mexico and Central America climate change adviser for Conservation International.

Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best.

The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning.

Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India.

The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding issues before the heads of government arrive to strike a deal.

High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's halls to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week.

The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and draft proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: hall
Target surface form: halls
Context:
This is clearly a game where a new economic hegemony is being developed, said Ulate, who also serves as the regional Mexico and Central America climate change adviser for Conservation International. Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best. The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning. Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India. The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding issues before the heads of government arrive to strike a deal. High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's <t>halls</t> to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week. The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and draft proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge.

Candidate senses:
1. sense_key=hall%1:06:03:: | definition=an interior passage or corridor onto which rooms open | synonyms=hallway | examples=the elevators were at the end of the hall
2. sense_key=hall%1:06:05:: | definition=a large entrance or reception room or area | synonyms=anteroom, antechamber, entrance hall, foyer, lobby, vestibule
3. sense_key=hall%1:06:02:: | definition=a large room for gatherings or entertainment | examples=lecture hall; pool hall
4. sense_key=hall%1:06:04:: | definition=a college or university building containing living quarters for students | synonyms=dormitory, dorm, residence hall, student residence
5. sense_key=hall%1:06:06:: | definition=the large room of a manor or castle | synonyms=manor hall
6. sense_key=hall%1:18:04:: | definition=English writer whose novel about a lesbian relationship was banned in Britain for many years (1883-1943) | synonyms=Radclyffe Hall, Marguerite Radclyffe Hall
7. sense_key=hall%1:18:03:: | definition=United States child psychologist whose theories of child psychology strongly influenced educational psychology (1844-1924) | synonyms=G. Stanley Hall, Granville Stanley Hall
8. sense_key=hall%1:18:02:: | definition=United States chemist who developed an economical method of producing aluminum from bauxite (1863-1914) | synonyms=Charles Martin Hall
9. sense_key=hall%1:18:01:: | definition=United States explorer who led three expeditions to the Arctic (1821-1871) | synonyms=Charles Francis Hall
10. sense_key=hall%1:18:00:: | definition=United States astronomer who discovered Phobos and Deimos (the two satellites of Mars) (1829-1907) | synonyms=Asaph Hall
11. sense_key=hall%1:06:07:: | definition=a large and imposing house | synonyms=mansion, mansion house, manse, residence
12. sense_key=hall%1:06:08:: | definition=a large building used by a college or university for teaching or research | examples=halls of learning
13. sense_key=hall%1:06:01:: | definition=a large building for meetings or entertainment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an interior passage or corridor onto which rooms open

    hall%1:06:03:: · hallway.n.01

    • the elevators were at the end of the hall

    Synonyms: hallway

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a large entrance or reception room or area

    hall%1:06:05:: · anteroom.n.01

    Synonyms: anteroom, antechamber, entrance hall, foyer, lobby, vestibule

    Gold lexEN Gold Maru 2022
  3. 3

    a large room for gatherings or entertainment

    hall%1:06:02:: · hall.n.03

    • lecture hall
    • pool hall
    Gold lexEN Gold Maru 2022
  4. 4

    a college or university building containing living quarters for students

    hall%1:06:04:: · dormitory.n.01

    Synonyms: dormitory, dorm, residence hall, student residence

  5. 5

    the large room of a manor or castle

    hall%1:06:06:: · manor_hall.n.01

    Synonyms: manor hall

  6. 6

    English writer whose novel about a lesbian relationship was banned in Britain for many years (1883-1943)

    hall%1:18:04:: · hall.n.06

    Synonyms: Radclyffe Hall, Marguerite Radclyffe Hall

  7. 7

    United States child psychologist whose theories of child psychology strongly influenced educational psychology (1844-1924)

    hall%1:18:03:: · hall.n.07

    Synonyms: G. Stanley Hall, Granville Stanley Hall

  8. 8

    United States chemist who developed an economical method of producing aluminum from bauxite (1863-1914)

    hall%1:18:02:: · hall.n.08

    Synonyms: Charles Martin Hall

  9. 9

    United States explorer who led three expeditions to the Arctic (1821-1871)

    hall%1:18:01:: · hall.n.09

    Synonyms: Charles Francis Hall

  10. 10

    United States astronomer who discovered Phobos and Deimos (the two satellites of Mars) (1829-1907)

    hall%1:18:00:: · hall.n.10

    Synonyms: Asaph Hall

  11. 11

    a large and imposing house

    hall%1:06:07:: · mansion.n.02

    Synonyms: mansion, mansion house, manse, residence

  12. 12

    a large building used by a college or university for teaching or research

    hall%1:06:08:: · hall.n.12

    • halls of learning
  13. 13

    a large building for meetings or entertainment

    hall%1:06:01:: · hall.n.13

    Selected

game Noun

Instance: semeval2013.d001.s004.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Baskonia gives away a victory in Israel

Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group.

The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph.

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Baskonia gives away a victory in Israel Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group. The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory. Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph. The <t>game</t> started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

return Noun

Instance: semeval2013.d001.s007.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph.

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: return
Target surface form: return
Context:
The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory. Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph. The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his <t>return</t> home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

Candidate senses:
1. sense_key=return%1:10:01:: | definition=document giving the tax collector information about the taxpayer's tax liability | synonyms=tax return, income tax return | examples=his gross income was enough that he had to file a tax return
2. sense_key=return%1:04:01:: | definition=a coming to or returning home | synonyms=homecoming | examples=on his return from Australia we gave him a welcoming party
3. sense_key=return%1:11:02:: | definition=the occurrence of a change in direction back in the opposite direction | synonyms=coming back
4. sense_key=return%1:04:02:: | definition=getting something back again | synonyms=restitution, restoration, regaining | examples=upon the restitution of the book to its rightful owner the child was given a tongue lashing
5. sense_key=return%1:04:00:: | definition=the act of going back to a prior location | examples=they set out on their return to the base camp
6. sense_key=return%1:21:00:: | definition=the income or profit arising from such transactions as the sale of land or other property | synonyms=issue, take, takings, proceeds, yield, payoff | examples=the average return was about 5%
7. sense_key=return%1:11:01:: | definition=happening again (especially at regular intervals) | synonyms=recurrence | examples=the return of spring
8. sense_key=return%1:10:02:: | definition=a quick reply to a question or remark (especially a witty or critical one) | synonyms=rejoinder, retort, riposte, replication, comeback, counter | examples=it brought a sharp rejoinder from the teacher
9. sense_key=return%1:06:00:: | definition=the key on electric typewriters or computer keyboards that causes a carriage return and a line feed | synonyms=return key
10. sense_key=return%1:04:06:: | definition=a reciprocal group action | synonyms=paying back, getting even | examples=in return we gave them as good as we got
11. sense_key=return%1:04:04:: | definition=a tennis stroke that sends the ball back to the other player | examples=he won the point on a cross-court return
12. sense_key=return%1:04:05:: | definition=(American football) the act of running back the ball after a kickoff or punt or interception or fumble
13. sense_key=return%1:04:07:: | definition=the act of someone appearing again | synonyms=reappearance | examples=his reappearance as Hamlet has been long awaited

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    document giving the tax collector information about the taxpayer's tax liability

    return%1:10:01:: · tax_return.n.01

    • his gross income was enough that he had to file a tax return

    Synonyms: tax return, income tax return

  2. 2

    a coming to or returning home

    return%1:04:01:: · return.n.02

    • on his return from Australia we gave him a welcoming party

    Synonyms: homecoming

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    the occurrence of a change in direction back in the opposite direction

    return%1:11:02:: · return.n.03

    Synonyms: coming back

  4. 4

    getting something back again

    return%1:04:02:: · restitution.n.03

    • upon the restitution of the book to its rightful owner the child was given a tongue lashing

    Synonyms: restitution, restoration, regaining

    Selected
  5. 5

    the act of going back to a prior location

    return%1:04:00:: · return.n.05

    • they set out on their return to the base camp
    Gold lexEN Gold Maru 2022
  6. 6

    the income or profit arising from such transactions as the sale of land or other property

    return%1:21:00:: · return.n.06

    • the average return was about 5%

    Synonyms: issue, take, takings, proceeds, yield, payoff

  7. 7

    happening again (especially at regular intervals)

    return%1:11:01:: · recurrence.n.01

    • the return of spring

    Synonyms: recurrence

  8. 8

    a quick reply to a question or remark (especially a witty or critical one)

    return%1:10:02:: · rejoinder.n.01

    • it brought a sharp rejoinder from the teacher

    Synonyms: rejoinder, retort, riposte, replication, comeback, counter

  9. 9

    the key on electric typewriters or computer keyboards that causes a carriage return and a line feed

    return%1:06:00:: · return_key.n.01

    Synonyms: return key

  10. 10

    a reciprocal group action

    return%1:04:06:: · return.n.10

    • in return we gave them as good as we got

    Synonyms: paying back, getting even

  11. 11

    a tennis stroke that sends the ball back to the other player

    return%1:04:04:: · return.n.11

    • he won the point on a cross-court return
  12. 12

    (American football) the act of running back the ball after a kickoff or punt or interception or fumble

    return%1:04:05:: · return.n.12

  13. 13

    the act of someone appearing again

    return%1:04:07:: · reappearance.n.02

    • his reappearance as Hamlet has been long awaited

    Synonyms: reappearance

game Noun

Instance: semeval2013.d001.s009.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the <t>game</t>, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d001.s009.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the <t>game</t>. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d001.s015.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77).

In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes. However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77). In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the <t>game</t> was already won and victory escaped Tel Aviv for the first time in the season.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

support Noun

Instance: semeval2013.d004.s000.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

US banks repay state support

The crisis-hit US major banks are breaking free from their state shackles.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: support
Target surface form: support
Context:
US banks repay state <t>support</t> The crisis-hit US major banks are breaking free from their state shackles.

Candidate senses:
1. sense_key=support%1:04:04:: | definition=the activity of providing for or maintaining by supplying with money or necessities | examples=his support kept the family together; they gave him emotional support during difficult times
2. sense_key=support%1:04:00:: | definition=aiding the cause or policy or interests of | examples=the president no longer has the support of his own party; they developed a scheme of mutual support
3. sense_key=support%1:09:00:: | definition=something providing immaterial assistance to a person or cause or interest | examples=the policy found little public support; his faith was all the support he needed
4. sense_key=support%1:04:03:: | definition=a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission | synonyms=reinforcement, reenforcement | examples=they called for artillery support
5. sense_key=support%1:04:02:: | definition=documentary validation | synonyms=documentation | examples=his documentation of the results was excellent; the strongest support for this view is the work of Jones
6. sense_key=support%1:21:00:: | definition=the financial means whereby one lives | synonyms=keep, livelihood, living, bread and butter, sustenance | examples=each child was expected to pay for their keep; he applied to the state for support
7. sense_key=support%1:06:01:: | definition=supporting structure that holds up or provides a foundation | examples=the statue stood on a marble support
8. sense_key=support%1:04:01:: | definition=the act of bearing the weight of or strengthening | synonyms=supporting | examples=he leaned against the wall for support
9. sense_key=support%1:10:01:: | definition=a musical part (vocal or instrumental) that supports or provides background for other musical parts | synonyms=accompaniment, musical accompaniment, backup
10. sense_key=support%1:06:00:: | definition=any device that bears the weight of another thing | examples=there was no place to attach supports for a shelf
11. sense_key=support%1:21:01:: | definition=financial resources provided to make some project possible | synonyms=financial support, funding, backing, financial backing | examples=the foundation provided support for the experiment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the activity of providing for or maintaining by supplying with money or necessities

    support%1:04:04:: · support.n.01

    • his support kept the family together
    • they gave him emotional support during difficult times
    Selected
  2. 2

    aiding the cause or policy or interests of

    support%1:04:00:: · support.n.02

    • the president no longer has the support of his own party
    • they developed a scheme of mutual support
  3. 3

    something providing immaterial assistance to a person or cause or interest

    support%1:09:00:: · support.n.03

    • the policy found little public support
    • his faith was all the support he needed
  4. 4

    a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission

    support%1:04:03:: · support.n.04

    • they called for artillery support

    Synonyms: reinforcement, reenforcement

  5. 5

    documentary validation

    support%1:04:02:: · documentation.n.03

    • his documentation of the results was excellent
    • the strongest support for this view is the work of Jones

    Synonyms: documentation

  6. 6

    the financial means whereby one lives

    support%1:21:00:: · support.n.06

    • each child was expected to pay for their keep
    • he applied to the state for support

    Synonyms: keep, livelihood, living, bread and butter, sustenance

  7. 7

    supporting structure that holds up or provides a foundation

    support%1:06:01:: · support.n.07

    • the statue stood on a marble support
  8. 8

    the act of bearing the weight of or strengthening

    support%1:04:01:: · support.n.08

    • he leaned against the wall for support

    Synonyms: supporting

  9. 9

    a musical part (vocal or instrumental) that supports or provides background for other musical parts

    support%1:10:01:: · accompaniment.n.02

    Synonyms: accompaniment, musical accompaniment, backup

  10. 10

    any device that bears the weight of another thing

    support%1:06:00:: · support.n.10

    • there was no place to attach supports for a shelf
  11. 11

    financial resources provided to make some project possible

    support%1:21:01:: · support.n.11

    • the foundation provided support for the experiment

    Synonyms: financial support, funding, backing, financial backing

    Gold lexEN Gold Maru 2022 Gold Raganato

support Noun

Instance: semeval2013.d004.s002.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

US banks repay state support

The crisis-hit US major banks are breaking free from their state shackles.

On Wednesday Bank of America repaid the support from the bank protection fund TARP in the amount USD 45 billion (nearly EUR 30 billion) in one go.

And, according to reports from US broadcaster CNBC, Citigroup is also planning to repay the state support.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: support
Target surface form: support
Context:
US banks repay state support The crisis-hit US major banks are breaking free from their state shackles. On Wednesday Bank of America repaid the <t>support</t> from the bank protection fund TARP in the amount USD 45 billion (nearly EUR 30 billion) in one go. And, according to reports from US broadcaster CNBC, Citigroup is also planning to repay the state support.

Candidate senses:
1. sense_key=support%1:04:04:: | definition=the activity of providing for or maintaining by supplying with money or necessities | examples=his support kept the family together; they gave him emotional support during difficult times
2. sense_key=support%1:04:00:: | definition=aiding the cause or policy or interests of | examples=the president no longer has the support of his own party; they developed a scheme of mutual support
3. sense_key=support%1:09:00:: | definition=something providing immaterial assistance to a person or cause or interest | examples=the policy found little public support; his faith was all the support he needed
4. sense_key=support%1:04:03:: | definition=a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission | synonyms=reinforcement, reenforcement | examples=they called for artillery support
5. sense_key=support%1:04:02:: | definition=documentary validation | synonyms=documentation | examples=his documentation of the results was excellent; the strongest support for this view is the work of Jones
6. sense_key=support%1:21:00:: | definition=the financial means whereby one lives | synonyms=keep, livelihood, living, bread and butter, sustenance | examples=each child was expected to pay for their keep; he applied to the state for support
7. sense_key=support%1:06:01:: | definition=supporting structure that holds up or provides a foundation | examples=the statue stood on a marble support
8. sense_key=support%1:04:01:: | definition=the act of bearing the weight of or strengthening | synonyms=supporting | examples=he leaned against the wall for support
9. sense_key=support%1:10:01:: | definition=a musical part (vocal or instrumental) that supports or provides background for other musical parts | synonyms=accompaniment, musical accompaniment, backup
10. sense_key=support%1:06:00:: | definition=any device that bears the weight of another thing | examples=there was no place to attach supports for a shelf
11. sense_key=support%1:21:01:: | definition=financial resources provided to make some project possible | synonyms=financial support, funding, backing, financial backing | examples=the foundation provided support for the experiment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the activity of providing for or maintaining by supplying with money or necessities

    support%1:04:04:: · support.n.01

    • his support kept the family together
    • they gave him emotional support during difficult times
    Selected
  2. 2

    aiding the cause or policy or interests of

    support%1:04:00:: · support.n.02

    • the president no longer has the support of his own party
    • they developed a scheme of mutual support
  3. 3

    something providing immaterial assistance to a person or cause or interest

    support%1:09:00:: · support.n.03

    • the policy found little public support
    • his faith was all the support he needed
  4. 4

    a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission

    support%1:04:03:: · support.n.04

    • they called for artillery support

    Synonyms: reinforcement, reenforcement

  5. 5

    documentary validation

    support%1:04:02:: · documentation.n.03

    • his documentation of the results was excellent
    • the strongest support for this view is the work of Jones

    Synonyms: documentation

  6. 6

    the financial means whereby one lives

    support%1:21:00:: · support.n.06

    • each child was expected to pay for their keep
    • he applied to the state for support

    Synonyms: keep, livelihood, living, bread and butter, sustenance

  7. 7

    supporting structure that holds up or provides a foundation

    support%1:06:01:: · support.n.07

    • the statue stood on a marble support
  8. 8

    the act of bearing the weight of or strengthening

    support%1:04:01:: · support.n.08

    • he leaned against the wall for support

    Synonyms: supporting

  9. 9

    a musical part (vocal or instrumental) that supports or provides background for other musical parts

    support%1:10:01:: · accompaniment.n.02

    Synonyms: accompaniment, musical accompaniment, backup

  10. 10

    any device that bears the weight of another thing

    support%1:06:00:: · support.n.10

    • there was no place to attach supports for a shelf
  11. 11

    financial resources provided to make some project possible

    support%1:21:01:: · support.n.11

    • the foundation provided support for the experiment

    Synonyms: financial support, funding, backing, financial backing

    Gold lexEN Gold Maru 2022 Gold Raganato

support Noun

Instance: semeval2013.d004.s003.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

US banks repay state support

The crisis-hit US major banks are breaking free from their state shackles.

On Wednesday Bank of America repaid the support from the bank protection fund TARP in the amount USD 45 billion (nearly EUR 30 billion) in one go.

And, according to reports from US broadcaster CNBC, Citigroup is also planning to repay the state support.

The institutions thereby want to wiggle themselves free from the restrictions going hand-in-hand with the acceptance of the money, such as the limits on manager bonuses and the paying of high charges.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: support
Target surface form: support
Context:
US banks repay state support The crisis-hit US major banks are breaking free from their state shackles. On Wednesday Bank of America repaid the support from the bank protection fund TARP in the amount USD 45 billion (nearly EUR 30 billion) in one go. And, according to reports from US broadcaster CNBC, Citigroup is also planning to repay the state <t>support</t>. The institutions thereby want to wiggle themselves free from the restrictions going hand-in-hand with the acceptance of the money, such as the limits on manager bonuses and the paying of high charges.

Candidate senses:
1. sense_key=support%1:04:04:: | definition=the activity of providing for or maintaining by supplying with money or necessities | examples=his support kept the family together; they gave him emotional support during difficult times
2. sense_key=support%1:04:00:: | definition=aiding the cause or policy or interests of | examples=the president no longer has the support of his own party; they developed a scheme of mutual support
3. sense_key=support%1:09:00:: | definition=something providing immaterial assistance to a person or cause or interest | examples=the policy found little public support; his faith was all the support he needed
4. sense_key=support%1:04:03:: | definition=a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission | synonyms=reinforcement, reenforcement | examples=they called for artillery support
5. sense_key=support%1:04:02:: | definition=documentary validation | synonyms=documentation | examples=his documentation of the results was excellent; the strongest support for this view is the work of Jones
6. sense_key=support%1:21:00:: | definition=the financial means whereby one lives | synonyms=keep, livelihood, living, bread and butter, sustenance | examples=each child was expected to pay for their keep; he applied to the state for support
7. sense_key=support%1:06:01:: | definition=supporting structure that holds up or provides a foundation | examples=the statue stood on a marble support
8. sense_key=support%1:04:01:: | definition=the act of bearing the weight of or strengthening | synonyms=supporting | examples=he leaned against the wall for support
9. sense_key=support%1:10:01:: | definition=a musical part (vocal or instrumental) that supports or provides background for other musical parts | synonyms=accompaniment, musical accompaniment, backup
10. sense_key=support%1:06:00:: | definition=any device that bears the weight of another thing | examples=there was no place to attach supports for a shelf
11. sense_key=support%1:21:01:: | definition=financial resources provided to make some project possible | synonyms=financial support, funding, backing, financial backing | examples=the foundation provided support for the experiment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the activity of providing for or maintaining by supplying with money or necessities

    support%1:04:04:: · support.n.01

    • his support kept the family together
    • they gave him emotional support during difficult times
    Selected
  2. 2

    aiding the cause or policy or interests of

    support%1:04:00:: · support.n.02

    • the president no longer has the support of his own party
    • they developed a scheme of mutual support
  3. 3

    something providing immaterial assistance to a person or cause or interest

    support%1:09:00:: · support.n.03

    • the policy found little public support
    • his faith was all the support he needed
  4. 4

    a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission

    support%1:04:03:: · support.n.04

    • they called for artillery support

    Synonyms: reinforcement, reenforcement

  5. 5

    documentary validation

    support%1:04:02:: · documentation.n.03

    • his documentation of the results was excellent
    • the strongest support for this view is the work of Jones

    Synonyms: documentation

  6. 6

    the financial means whereby one lives

    support%1:21:00:: · support.n.06

    • each child was expected to pay for their keep
    • he applied to the state for support

    Synonyms: keep, livelihood, living, bread and butter, sustenance

  7. 7

    supporting structure that holds up or provides a foundation

    support%1:06:01:: · support.n.07

    • the statue stood on a marble support
  8. 8

    the act of bearing the weight of or strengthening

    support%1:04:01:: · support.n.08

    • he leaned against the wall for support

    Synonyms: supporting

  9. 9

    a musical part (vocal or instrumental) that supports or provides background for other musical parts

    support%1:10:01:: · accompaniment.n.02

    Synonyms: accompaniment, musical accompaniment, backup

  10. 10

    any device that bears the weight of another thing

    support%1:06:00:: · support.n.10

    • there was no place to attach supports for a shelf
  11. 11

    financial resources provided to make some project possible

    support%1:21:01:: · support.n.11

    • the foundation provided support for the experiment

    Synonyms: financial support, funding, backing, financial backing

    Gold lexEN Gold Maru 2022 Gold Raganato

support Noun

Instance: semeval2013.d004.s012.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Bank head Kenneth Lewis extended his express thanks to the American taxpayer on Wednesday evening: The cash injection helped over a very difficult time.

The bank overstretched at the height of the financial crisis by taking over the investment bank Merrill Lynch.

Citigroup also plans to raise cash on the capital market to free itself from its liabilities with the state.

Already on Thursday, the US bank was able to announce a capital increase of some USD 20 billion, reported CNBC with reference to circles.

A Citigroup spokesman declined to comment.

Goldman Sachs, JP Morgan Chase and Morgan Stanley had already repaid their support in June.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: support
Target surface form: support
Context:
Bank head Kenneth Lewis extended his express thanks to the American taxpayer on Wednesday evening: The cash injection helped over a very difficult time. The bank overstretched at the height of the financial crisis by taking over the investment bank Merrill Lynch. Citigroup also plans to raise cash on the capital market to free itself from its liabilities with the state. Already on Thursday, the US bank was able to announce a capital increase of some USD 20 billion, reported CNBC with reference to circles. A Citigroup spokesman declined to comment. Goldman Sachs, JP Morgan Chase and Morgan Stanley had already repaid their <t>support</t> in June.

Candidate senses:
1. sense_key=support%1:04:04:: | definition=the activity of providing for or maintaining by supplying with money or necessities | examples=his support kept the family together; they gave him emotional support during difficult times
2. sense_key=support%1:04:00:: | definition=aiding the cause or policy or interests of | examples=the president no longer has the support of his own party; they developed a scheme of mutual support
3. sense_key=support%1:09:00:: | definition=something providing immaterial assistance to a person or cause or interest | examples=the policy found little public support; his faith was all the support he needed
4. sense_key=support%1:04:03:: | definition=a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission | synonyms=reinforcement, reenforcement | examples=they called for artillery support
5. sense_key=support%1:04:02:: | definition=documentary validation | synonyms=documentation | examples=his documentation of the results was excellent; the strongest support for this view is the work of Jones
6. sense_key=support%1:21:00:: | definition=the financial means whereby one lives | synonyms=keep, livelihood, living, bread and butter, sustenance | examples=each child was expected to pay for their keep; he applied to the state for support
7. sense_key=support%1:06:01:: | definition=supporting structure that holds up or provides a foundation | examples=the statue stood on a marble support
8. sense_key=support%1:04:01:: | definition=the act of bearing the weight of or strengthening | synonyms=supporting | examples=he leaned against the wall for support
9. sense_key=support%1:10:01:: | definition=a musical part (vocal or instrumental) that supports or provides background for other musical parts | synonyms=accompaniment, musical accompaniment, backup
10. sense_key=support%1:06:00:: | definition=any device that bears the weight of another thing | examples=there was no place to attach supports for a shelf
11. sense_key=support%1:21:01:: | definition=financial resources provided to make some project possible | synonyms=financial support, funding, backing, financial backing | examples=the foundation provided support for the experiment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the activity of providing for or maintaining by supplying with money or necessities

    support%1:04:04:: · support.n.01

    • his support kept the family together
    • they gave him emotional support during difficult times
    Selected
  2. 2

    aiding the cause or policy or interests of

    support%1:04:00:: · support.n.02

    • the president no longer has the support of his own party
    • they developed a scheme of mutual support
  3. 3

    something providing immaterial assistance to a person or cause or interest

    support%1:09:00:: · support.n.03

    • the policy found little public support
    • his faith was all the support he needed
  4. 4

    a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission

    support%1:04:03:: · support.n.04

    • they called for artillery support

    Synonyms: reinforcement, reenforcement

  5. 5

    documentary validation

    support%1:04:02:: · documentation.n.03

    • his documentation of the results was excellent
    • the strongest support for this view is the work of Jones

    Synonyms: documentation

  6. 6

    the financial means whereby one lives

    support%1:21:00:: · support.n.06

    • each child was expected to pay for their keep
    • he applied to the state for support

    Synonyms: keep, livelihood, living, bread and butter, sustenance

  7. 7

    supporting structure that holds up or provides a foundation

    support%1:06:01:: · support.n.07

    • the statue stood on a marble support
  8. 8

    the act of bearing the weight of or strengthening

    support%1:04:01:: · support.n.08

    • he leaned against the wall for support

    Synonyms: supporting

  9. 9

    a musical part (vocal or instrumental) that supports or provides background for other musical parts

    support%1:10:01:: · accompaniment.n.02

    Synonyms: accompaniment, musical accompaniment, backup

  10. 10

    any device that bears the weight of another thing

    support%1:06:00:: · support.n.10

    • there was no place to attach supports for a shelf
  11. 11

    financial resources provided to make some project possible

    support%1:21:01:: · support.n.11

    • the foundation provided support for the experiment

    Synonyms: financial support, funding, backing, financial backing

    Gold lexEN Gold Maru 2022 Gold Raganato

rule Noun

Instance: semeval2013.d005.s030.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Mr. Hayes's lawyers are pressing that claim.

In their filing, they referred to the Supreme Court's 1966 decision overturning Dr. Sheppard's conviction because of the trial coverage and made it clear they would claim that the new media required new rules.

"This case," they wrote, "represents the Sheppard v. Maxwell of the 21st century."

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: rule
Target surface form: rules
Context:
"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts. Mr. Hayes's lawyers are pressing that claim. In their filing, they referred to the Supreme Court's 1966 decision overturning Dr. Sheppard's conviction because of the trial coverage and made it clear they would claim that the new media required new <t>rules</t>. "This case," they wrote, "represents the Sheppard v. Maxwell of the 21st century."

Candidate senses:
1. sense_key=rule%1:09:00:: | definition=a principle or condition that customarily governs behavior | synonyms=regulation | examples=it was his rule to take a walk before breakfast; short haircuts were the regulation
2. sense_key=rule%1:09:01:: | definition=something regarded as a normative example | synonyms=convention, normal, pattern, formula | examples=the convention of not naming the main character; violence is the rule not the exception
3. sense_key=rule%1:10:00:: | definition=prescribed guide for conduct or action | synonyms=prescript
4. sense_key=rule%1:10:01:: | definition=(linguistics) a rule describing (or prescribing) a linguistic practice | synonyms=linguistic rule
5. sense_key=rule%1:09:03:: | definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | synonyms=principle | examples=their principles of composition characterized all their works
6. sense_key=rule%1:28:00:: | definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
7. sense_key=rule%1:26:00:: | definition=dominance or power through legal authority | synonyms=dominion | examples=France held undisputed dominion over vast areas of Africa; the rule of Caesar
8. sense_key=rule%1:10:02:: | definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
9. sense_key=rule%1:10:03:: | definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
10. sense_key=rule%1:09:02:: | definition=a rule or law concerning a natural phenomenon or the function of a complex system | synonyms=principle | examples=the principle of the conservation of mass; the principle of jet propulsion
11. sense_key=rule%1:09:04:: | definition=(mathematics) a standard procedure for solving a class of mathematical problems | synonyms=formula | examples=he determined the upper bound with Descartes' rule of signs; he gave us a general formula for attacking polynomials
12. sense_key=rule%1:06:00:: | definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths | synonyms=ruler

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

    Gold Raganato Selected
  2. 2

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

  3. 3

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  5. 5

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  6. 6

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  7. 7

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

  8. 8

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
  9. 9

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic
  10. 10

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  11. 11

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  12. 12

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler

game Noun

Instance: semeval2013.d006.s002.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Sport and fraud law

Tricks such as those of Alonso and Ramos before the Ajax demonstrate wittiness but not the will to get remove of a sanction.

The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA.

As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Sport and fraud law Tricks such as those of Alonso and Ramos before the Ajax demonstrate wittiness but not the will to get remove of a sanction. The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the <t>game</t> played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA. As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games