Verified run

google/gemma-4-26B-A4B-it

vllm-gemma-4-26b-a4b-fp8-a100-p001-lexen-v1-20260614

Rank
68
Accuracy lexEN v1 · WordNet fine
89.43%
Correct
4347 / 4861
Actual run cost
$0.0636
Cost / M items
$13.08

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 89.43% 4347 / 4861 95.58% 4646 / 4861 93.68% 4554 / 4861
Maru 2022 (ALLamended) 87.16% 4237 / 4861 95.00% 4618 / 4861 92.26% 4485 / 4861
Raganato 2017 (original) 81.75% 3974 / 4861 92.49% 4496 / 4861 88.62% 4308 / 4861

Model

Display
google/gemma-4-26B-A4B-it
Requested
hosted_vllm/google/gemma-4-26B-A4B-it
Resolved
google/gemma-4-26B-A4B-it
Vendor
Google
API provider
n/a
Hosting
self_hosted
Source
open_source
License
gemma
Reasoning
no reasoning
Model URL
https://huggingface.co/google/gemma-4-26B-A4B-it
Endpoint
http://localhost:8000/v1
Resolved counts
google/gemma-4-26B-A4B-it: 4861
HF revision
8edbb9269ec9c3faad538ee1208a07eb46051f34
Quantization
fp8
Inference engine
vllm
Engine version
0.22.1
Container image
vllm/vllm-openai:v0.22.1
Serve command
exec vllm serve RedHatAI/gemma-4-26B-A4B-it-FP8-Dynamic --port 8000 --served-model-name google/gemma-4-26B-A4B-it --max-model-len 8192 --gpu-memory-utilization 0.90 --max-num-seqs 256 --no-enable-prefix-caching --language-model-only --revision 8edbb9269ec9c3faad538ee1208a07eb46051f34

Reproducibility

Created
2026-06-14T13:02:48.331932+00:00
Run schema
sensebench-run-v2
Commit
n/a
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p001
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
3,248,051
Tokens / item
668.2
Total cost
$0.0636
Cost / M items
$13.08
Cost source
machine_time_estimate
Elapsed
3.49m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Machine & Timing

GPU
NVIDIA A100-SXM4-80GB
VRAM / GPU
81,920 MiB
Driver
570.195.03
CUDA
13.0
CPU
AMD EPYC 7513 32-Core Processor (128 cores)
RAM
1,385.7 GiB
Platform
Linux-5.15.0-160-generic-x86_64-with-glibc2.35
Provider
vast.ai (40919271)
Hourly rate
$1.09/h
Benchmark time
3.49m
Machine-hours / 1M items
12.0 h/M
Concurrency
96

Benchmark time covers only the per-item evaluation loop on this machine, excluding model and asset loading.

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
2,048
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.0636. Cost estimate source: machine_time_estimate. Cost is estimated from machine time multiplied by the recorded hourly rate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 3,178,178 n/a n/a
Input cached n/a n/a n/a
Output 69,873 n/a n/a
Reasoning output n/a included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 83.88% 666 794
Candidate Count 2 94.50% 808 855
Candidate Count 3-5 90.59% 1762 1945
Candidate Count 6-10 87.69% 1111 1267
POS ADJ 91.65% 604 659
POS ADV 86.15% 168 195
POS NOUN 90.51% 2622 2897
POS VERB 85.86% 953 1110
Source Dataset semeval2013 91.75% 1046 1140
Source Dataset semeval2015 90.53% 669 739
Source Dataset senseval2 88.21% 1437 1629
Source Dataset senseval3 88.32% 1195 1353

Worst-Bucket Examples

game Noun

Instance: semeval2013.d001.s004.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Baskonia gives away a victory in Israel

Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group.

The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph.

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Baskonia gives away a victory in Israel Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group. The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory. Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph. The <t>game</t> started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d001.s009.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the <t>game</t>, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d001.s009.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the <t>game</t>. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d001.s015.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

More disadvantages

Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67).

The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes.

However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77).

In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the game was already won and victory escaped Tel Aviv for the first time in the season.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Eidson and Pnini played a decisive role in the "yellows'" return to the light. More disadvantages Ivanovic's players, injured but far from dead, needed to run a couple of plays correctly before they could breathe, and that's when the machine gun Marza Teletovic arrived, with three almost consecutive three-pointers and the help of English and Ribas, he brought the scoreboard back to a reassuring lead (54-67), which the home team managed to narrow down at the end of the third quarter (57-67). The Alavas worked themselves to the bone in the last period, and English and San Emeterio (65-75) had already made it clear that they were not going to let anyone take away what they had earned during the first thirty minutes. However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77). In spite of this, and with Splitter fouling out, Ivonic's team didn't rush, defended well, and, even though the Israelis came close at the last minute, the <t>game</t> was already won and victory escaped Tel Aviv for the first time in the season.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

court Noun

Instance: semeval2013.d005.s005.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Cheshire Appeal Will Point to Twitter

There were half a dozen of them typing away in the courtroom rows.

Minute by minute, they sent out reports of gruesome testimony via Twitter.

In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze.

On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury.

But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years.

One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: courts
Context:
Cheshire Appeal Will Point to Twitter There were half a dozen of them typing away in the courtroom rows. Minute by minute, they sent out reports of gruesome testimony via Twitter. In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze. On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury. But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the <t>courts</t> for years. One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions.

Candidate senses:
1. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

rule Noun

Instance: semeval2013.d005.s007.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Minute by minute, they sent out reports of gruesome testimony via Twitter.

In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze.

On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury.

But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years.

One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions.

The claim could force appeals judges to grapple with the question of whether new technology requires new courtroom rules.

"As I experienced it during this trial, I think there's a real danger that the inclusion of new technology in the courtroom is affecting an individual's fair-trial rights," said Thomas J. Ullmann, Mr. Hayes's chief defense lawyer.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: rule
Target surface form: rules
Context:
Minute by minute, they sent out reports of gruesome testimony via Twitter. In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze. On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury. But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years. One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions. The claim could force appeals judges to grapple with the question of whether new technology requires new courtroom <t>rules</t>. "As I experienced it during this trial, I think there's a real danger that the inclusion of new technology in the courtroom is affecting an individual's fair-trial rights," said Thomas J. Ullmann, Mr. Hayes's chief defense lawyer.

Candidate senses:
1. sense_key=rule%1:09:00:: | definition=a principle or condition that customarily governs behavior | synonyms=regulation | examples=it was his rule to take a walk before breakfast; short haircuts were the regulation
2. sense_key=rule%1:09:01:: | definition=something regarded as a normative example | synonyms=convention, normal, pattern, formula | examples=the convention of not naming the main character; violence is the rule not the exception
3. sense_key=rule%1:10:00:: | definition=prescribed guide for conduct or action | synonyms=prescript
4. sense_key=rule%1:10:01:: | definition=(linguistics) a rule describing (or prescribing) a linguistic practice | synonyms=linguistic rule
5. sense_key=rule%1:09:03:: | definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | synonyms=principle | examples=their principles of composition characterized all their works
6. sense_key=rule%1:28:00:: | definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
7. sense_key=rule%1:26:00:: | definition=dominance or power through legal authority | synonyms=dominion | examples=France held undisputed dominion over vast areas of Africa; the rule of Caesar
8. sense_key=rule%1:10:02:: | definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
9. sense_key=rule%1:10:03:: | definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
10. sense_key=rule%1:09:02:: | definition=a rule or law concerning a natural phenomenon or the function of a complex system | synonyms=principle | examples=the principle of the conservation of mass; the principle of jet propulsion
11. sense_key=rule%1:09:04:: | definition=(mathematics) a standard procedure for solving a class of mathematical problems | synonyms=formula | examples=he determined the upper bound with Descartes' rule of signs; he gave us a general formula for attacking polynomials
12. sense_key=rule%1:06:00:: | definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths | synonyms=ruler

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

    Selected
  2. 2

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

  3. 3

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  5. 5

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  6. 6

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  7. 7

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

  8. 8

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
  9. 9

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic
  10. 10

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  11. 11

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  12. 12

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler

court Noun

Instance: semeval2013.d005.s027.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But their arguments about the effect of the intense coverage of the trial may draw the most interest.

They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

They argued that the news media continually fanned the flames of emotion about the case.

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: court
Context:
But their arguments about the effect of the intense coverage of the trial may draw the most interest. They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate. They argued that the news media continually fanned the flames of emotion about the case. "The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor <t>court</t> policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Candidate senses:
1. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

court Noun

Instance: semeval2013.d005.s028.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

They argued that the news media continually fanned the flames of emotion about the case.

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Mr. Hayes's lawyers are pressing that claim.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: courts
Context:
They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate. They argued that the news media continually fanned the flames of emotion about the case. "The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the <t>courts</t>. Mr. Hayes's lawyers are pressing that claim.

Candidate senses:
1. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

game Noun

Instance: semeval2013.d006.s002.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Sport and fraud law

Tricks such as those of Alonso and Ramos before the Ajax demonstrate wittiness but not the will to get remove of a sanction.

The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA.

As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Sport and fraud law Tricks such as those of Alonso and Ramos before the Ajax demonstrate wittiness but not the will to get remove of a sanction. The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the <t>game</t> played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA. As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d006.s004.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Sport and fraud law

Tricks such as those of Alonso and Ramos before the Ajax demonstrate wittiness but not the will to get remove of a sanction.

The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA.

As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase.

Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
Sport and fraud law Tricks such as those of Alonso and Ramos before the Ajax demonstrate wittiness but not the will to get remove of a sanction. The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA. As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them. This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next <t>game</t> of league, against Auxerre, and will be able to get rid of the cards the following phase. Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

game Noun

Instance: semeval2013.d006.s005.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Sport and fraud law

Tricks such as those of Alonso and Ramos before the Ajax demonstrate wittiness but not the will to get remove of a sanction.

The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA.

As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase.

Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players.

The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: games
Context:
Sport and fraud law Tricks such as those of Alonso and Ramos before the Ajax demonstrate wittiness but not the will to get remove of a sanction. The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA. As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them. This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase. Finally, the committee of discipline of the UEFA has sanctioned with two <t>games</t> the trainer of the team, Jose Mourinho, and with different economic amounts the implied players. The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

rule Noun

Instance: semeval2013.d006.s007.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA.

As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase.

Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players.

The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football.

It is so extended that it part of the ethos, of the unwritten rules, but followed nonetheless by this sport.

Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: rule
Target surface form: rules
Context:
The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA. As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them. This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase. Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players. The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football. It is so extended that it part of the ethos, of the unwritten <t>rules</t>, but followed nonetheless by this sport. Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Candidate senses:
1. sense_key=rule%1:09:00:: | definition=a principle or condition that customarily governs behavior | synonyms=regulation | examples=it was his rule to take a walk before breakfast; short haircuts were the regulation
2. sense_key=rule%1:09:01:: | definition=something regarded as a normative example | synonyms=convention, normal, pattern, formula | examples=the convention of not naming the main character; violence is the rule not the exception
3. sense_key=rule%1:10:00:: | definition=prescribed guide for conduct or action | synonyms=prescript
4. sense_key=rule%1:10:01:: | definition=(linguistics) a rule describing (or prescribing) a linguistic practice | synonyms=linguistic rule
5. sense_key=rule%1:09:03:: | definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | synonyms=principle | examples=their principles of composition characterized all their works
6. sense_key=rule%1:28:00:: | definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
7. sense_key=rule%1:26:00:: | definition=dominance or power through legal authority | synonyms=dominion | examples=France held undisputed dominion over vast areas of Africa; the rule of Caesar
8. sense_key=rule%1:10:02:: | definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
9. sense_key=rule%1:10:03:: | definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
10. sense_key=rule%1:09:02:: | definition=a rule or law concerning a natural phenomenon or the function of a complex system | synonyms=principle | examples=the principle of the conservation of mass; the principle of jet propulsion
11. sense_key=rule%1:09:04:: | definition=(mathematics) a standard procedure for solving a class of mathematical problems | synonyms=formula | examples=he determined the upper bound with Descartes' rule of signs; he gave us a general formula for attacking polynomials
12. sense_key=rule%1:06:00:: | definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths | synonyms=ruler

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

    Gold Raganato
  2. 2

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

    Selected
  3. 3

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

  4. 4

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  5. 5

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  6. 6

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  7. 7

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

  8. 8

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
    Gold lexEN Gold Maru 2022
  9. 9

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic
  10. 10

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  11. 11

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  12. 12

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler