Verified run

nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B

vllm-nemotron-3-nano-30b-fp8-h100-p001-lexen-v1-20260614

Rank
175
Accuracy lexEN v1 · WordNet fine
63.55%
Correct
3089 / 4861
Actual run cost
$0.0350
Cost / M items
$7.19

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 63.55% 3089 / 4861 82.64% 4017 / 4861 74.80% 3636 / 4861
Maru 2022 (ALLamended) 62.62% 3044 / 4861 82.14% 3993 / 4861 74.33% 3613 / 4861
Raganato 2017 (original) 58.49% 2843 / 4861 80.25% 3901 / 4861 71.61% 3481 / 4861

Model

Display
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B
Requested
hosted_vllm/nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B
Resolved
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B
Vendor
NVIDIA
API provider
n/a
Hosting
self_hosted
Source
open_source
License
nvidia-open
Reasoning
n/a
Model URL
https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B
Endpoint
http://localhost:8000/v1
Resolved counts
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B: 4861
HF revision
f8dc1c0afee92f44417695b4f5ddca9afc95ea58
Quantization
fp8
Inference engine
vllm
Engine version
0.22.1
Container image
vllm/vllm-openai:v0.22.1
Serve command
exec vllm serve nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 --port 8000 --served-model-name nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B --max-model-len 8192 --gpu-memory-utilization 0.90 --trust-remote-code --max-num-seqs 128 --default-chat-template-kwargs \{\"enable_thinking\":\ false\} --revision f8dc1c0afee92f44417695b4f5ddca9afc95ea58

Reproducibility

Created
2026-06-14T17:08:07.789507+00:00
Run schema
sensebench-run-v2
Commit
n/a
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p001
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
3,206,048
Tokens / item
659.5
Total cost
$0.0350
Cost / M items
$7.19
Cost source
machine_time_estimate
Elapsed
54.74s
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Machine & Timing

GPU
NVIDIA H100 80GB HBM3
VRAM / GPU
81,559 MiB
Driver
595.71.05
CUDA
13.2
CPU
AMD EPYC 7R13 Processor (192 cores)
RAM
1,999.9 GiB
Platform
Linux-6.17.0-1017-aws-x86_64-with-glibc2.35
Provider
vast.ai (40919268)
Hourly rate
$2.30/h
Benchmark time
54.74s
Machine-hours / 1M items
3.13 h/M
Concurrency
128

Benchmark time covers only the per-item evaluation loop on this machine, excluding model and asset loading.

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
2,048
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.0350. Cost estimate source: machine_time_estimate. Cost is estimated from machine time multiplied by the recorded hourly rate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 3,162,078 n/a n/a
Input cached n/a n/a n/a
Output 43,970 n/a n/a
Reasoning output n/a included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 46.85% 372 794
Candidate Count 2 87.60% 749 855
Candidate Count 3-5 67.81% 1319 1945
Candidate Count 6-10 51.22% 649 1267
POS ADJ 69.80% 460 659
POS ADV 55.38% 108 195
POS NOUN 68.10% 1973 2897
POS VERB 49.37% 548 1110
Source Dataset semeval2013 72.19% 823 1140
Source Dataset semeval2015 67.52% 499 739
Source Dataset senseval2 62.06% 1011 1629
Source Dataset senseval3 55.88% 756 1353

Worst-Bucket Examples

issue Noun

Instance: semeval2013.d000.s023.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Ricardo Ulate, a Costa Rican delegate, said it's not surprising that the major powers are fighting over who should bear the costs for curbing greenhouse gases, even as vulnerable countries have become more aggressive in seeking to hold the big emitters accountable for their actions.

This is clearly a game where a new economic hegemony is being developed, said Ulate, who also serves as the regional Mexico and Central America climate change adviser for Conservation International.

Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best.

The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning.

Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India.

The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding issues before the heads of government arrive to strike a deal.

High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's halls to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: issue
Target surface form: issues
Context:
Ricardo Ulate, a Costa Rican delegate, said it's not surprising that the major powers are fighting over who should bear the costs for curbing greenhouse gases, even as vulnerable countries have become more aggressive in seeking to hold the big emitters accountable for their actions. This is clearly a game where a new economic hegemony is being developed, said Ulate, who also serves as the regional Mexico and Central America climate change adviser for Conservation International. Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best. The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning. Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India. The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding <t>issues</t> before the heads of government arrive to strike a deal. High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's halls to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week.

Candidate senses:
1. sense_key=issue%1:09:01:: | definition=an important question that is in dispute and must be settled | examples=the issue could be settled by requiring public education for everyone; politicians never discuss the real issues
2. sense_key=issue%1:10:00:: | definition=one of a series published periodically | synonyms=number | examples=she found an old issue of the magazine in her dentist's waiting room
3. sense_key=issue%1:09:00:: | definition=some situation or event that is thought about | synonyms=topic, subject, matter | examples=he kept drifting off the topic; he had been thinking about the subject for several years
4. sense_key=issue%1:04:01:: | definition=the act of providing an item for general use or for official purposes (usually in quantity) | synonyms=issuing, issuance | examples=a new issue of stamps; the last issue of penicillin was over a month ago
5. sense_key=issue%1:21:01:: | definition=supplies (as food or clothing or ammunition) issued by the government | synonyms=military issue, government issue
6. sense_key=issue%1:21:00:: | definition=the income or profit arising from such transactions as the sale of land or other property | synonyms=return, take, takings, proceeds, yield, payoff | examples=the average return was about 5%
7. sense_key=issue%1:19:00:: | definition=a phenomenon that follows and is caused by some previous phenomenon | synonyms=consequence, effect, outcome, result, event, upshot | examples=the magnetic effect was greater when the rod was lengthwise; his decision had depressing consequences for business
8. sense_key=issue%1:18:00:: | definition=the immediate descendants of a person | synonyms=offspring, progeny | examples=she was the mother of many offspring; he died without issue
9. sense_key=issue%1:11:00:: | definition=the becoming visible | synonyms=emergence, egress | examples=not a day's difference between the emergence of the andrenas and the opening of the willow catkins
10. sense_key=issue%1:06:00:: | definition=an opening that permits escape or release | synonyms=exit, outlet, way out | examples=he blocked the way out; the canyon had only one issue
11. sense_key=issue%1:04:00:: | definition=the act of issuing printed materials | synonyms=publication

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an important question that is in dispute and must be settled

    issue%1:09:01:: · issue.n.01

    • the issue could be settled by requiring public education for everyone
    • politicians never discuss the real issues
    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    one of a series published periodically

    issue%1:10:00:: · issue.n.02

    • she found an old issue of the magazine in her dentist's waiting room

    Synonyms: number

  3. 3

    some situation or event that is thought about

    issue%1:09:00:: · topic.n.02

    • he kept drifting off the topic
    • he had been thinking about the subject for several years

    Synonyms: topic, subject, matter

    Selected
  4. 4

    the act of providing an item for general use or for official purposes (usually in quantity)

    issue%1:04:01:: · issue.n.04

    • a new issue of stamps
    • the last issue of penicillin was over a month ago

    Synonyms: issuing, issuance

  5. 5

    supplies (as food or clothing or ammunition) issued by the government

    issue%1:21:01:: · issue.n.05

    Synonyms: military issue, government issue

  6. 6

    the income or profit arising from such transactions as the sale of land or other property

    issue%1:21:00:: · return.n.06

    • the average return was about 5%

    Synonyms: return, take, takings, proceeds, yield, payoff

  7. 7

    a phenomenon that follows and is caused by some previous phenomenon

    issue%1:19:00:: · consequence.n.01

    • the magnetic effect was greater when the rod was lengthwise
    • his decision had depressing consequences for business

    Synonyms: consequence, effect, outcome, result, event, upshot

  8. 8

    the immediate descendants of a person

    issue%1:18:00:: · offspring.n.01

    • she was the mother of many offspring
    • he died without issue

    Synonyms: offspring, progeny

  9. 9

    the becoming visible

    issue%1:11:00:: · emergence.n.02

    • not a day's difference between the emergence of the andrenas and the opening of the willow catkins

    Synonyms: emergence, egress

  10. 10

    an opening that permits escape or release

    issue%1:06:00:: · exit.n.01

    • he blocked the way out
    • the canyon had only one issue

    Synonyms: exit, outlet, way out

  11. 11

    the act of issuing printed materials

    issue%1:04:00:: · issue.n.11

    Synonyms: publication

hall Noun

Instance: semeval2013.d000.s024.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

This is clearly a game where a new economic hegemony is being developed, said Ulate, who also serves as the regional Mexico and Central America climate change adviser for Conservation International.

Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best.

The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning.

Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India.

The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding issues before the heads of government arrive to strike a deal.

High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's halls to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week.

The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and draft proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: hall
Target surface form: halls
Context:
This is clearly a game where a new economic hegemony is being developed, said Ulate, who also serves as the regional Mexico and Central America climate change adviser for Conservation International. Some of the countries most vulnerable to the impact of climate change indicated they would continue to push for a legally binding treaty in Copenhagen, although most of the major participants say the talks will produce a political deal at best. The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning. Artur Runge-Metzger, who heads international climate negotiations on behalf of the European Commission, said the push by small island nations has "put political pressure on the entire political process," in part because they are now unified and demanding action from emerging economies such as China and India. The talks took on new urgency as delegates focused on the fact that they must resolve most of the outstanding issues before the heads of government arrive to strike a deal. High-level officials such as Indian environment minister Jairam Ramesh and the Chinese vice minister stepped off planes and raced through the Bella Center's <t>halls</t> to closed-door meetings and news conferences so they could stake out claims that will be arbitrated over the next week. The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and draft proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge.

Candidate senses:
1. sense_key=hall%1:06:03:: | definition=an interior passage or corridor onto which rooms open | synonyms=hallway | examples=the elevators were at the end of the hall
2. sense_key=hall%1:06:05:: | definition=a large entrance or reception room or area | synonyms=anteroom, antechamber, entrance hall, foyer, lobby, vestibule
3. sense_key=hall%1:06:02:: | definition=a large room for gatherings or entertainment | examples=lecture hall; pool hall
4. sense_key=hall%1:06:04:: | definition=a college or university building containing living quarters for students | synonyms=dormitory, dorm, residence hall, student residence
5. sense_key=hall%1:06:06:: | definition=the large room of a manor or castle | synonyms=manor hall
6. sense_key=hall%1:18:04:: | definition=English writer whose novel about a lesbian relationship was banned in Britain for many years (1883-1943) | synonyms=Radclyffe Hall, Marguerite Radclyffe Hall
7. sense_key=hall%1:18:03:: | definition=United States child psychologist whose theories of child psychology strongly influenced educational psychology (1844-1924) | synonyms=G. Stanley Hall, Granville Stanley Hall
8. sense_key=hall%1:18:02:: | definition=United States chemist who developed an economical method of producing aluminum from bauxite (1863-1914) | synonyms=Charles Martin Hall
9. sense_key=hall%1:18:01:: | definition=United States explorer who led three expeditions to the Arctic (1821-1871) | synonyms=Charles Francis Hall
10. sense_key=hall%1:18:00:: | definition=United States astronomer who discovered Phobos and Deimos (the two satellites of Mars) (1829-1907) | synonyms=Asaph Hall
11. sense_key=hall%1:06:07:: | definition=a large and imposing house | synonyms=mansion, mansion house, manse, residence
12. sense_key=hall%1:06:08:: | definition=a large building used by a college or university for teaching or research | examples=halls of learning
13. sense_key=hall%1:06:01:: | definition=a large building for meetings or entertainment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an interior passage or corridor onto which rooms open

    hall%1:06:03:: · hallway.n.01

    • the elevators were at the end of the hall

    Synonyms: hallway

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a large entrance or reception room or area

    hall%1:06:05:: · anteroom.n.01

    Synonyms: anteroom, antechamber, entrance hall, foyer, lobby, vestibule

    Gold lexEN Gold Maru 2022
  3. 3

    a large room for gatherings or entertainment

    hall%1:06:02:: · hall.n.03

    • lecture hall
    • pool hall
    Gold lexEN Gold Maru 2022
  4. 4

    a college or university building containing living quarters for students

    hall%1:06:04:: · dormitory.n.01

    Synonyms: dormitory, dorm, residence hall, student residence

  5. 5

    the large room of a manor or castle

    hall%1:06:06:: · manor_hall.n.01

    Synonyms: manor hall

  6. 6

    English writer whose novel about a lesbian relationship was banned in Britain for many years (1883-1943)

    hall%1:18:04:: · hall.n.06

    Synonyms: Radclyffe Hall, Marguerite Radclyffe Hall

  7. 7

    United States child psychologist whose theories of child psychology strongly influenced educational psychology (1844-1924)

    hall%1:18:03:: · hall.n.07

    Synonyms: G. Stanley Hall, Granville Stanley Hall

  8. 8

    United States chemist who developed an economical method of producing aluminum from bauxite (1863-1914)

    hall%1:18:02:: · hall.n.08

    Synonyms: Charles Martin Hall

  9. 9

    United States explorer who led three expeditions to the Arctic (1821-1871)

    hall%1:18:01:: · hall.n.09

    Synonyms: Charles Francis Hall

  10. 10

    United States astronomer who discovered Phobos and Deimos (the two satellites of Mars) (1829-1907)

    hall%1:18:00:: · hall.n.10

    Synonyms: Asaph Hall

  11. 11

    a large and imposing house

    hall%1:06:07:: · mansion.n.02

    Synonyms: mansion, mansion house, manse, residence

  12. 12

    a large building used by a college or university for teaching or research

    hall%1:06:08:: · hall.n.12

    • halls of learning
  13. 13

    a large building for meetings or entertainment

    hall%1:06:01:: · hall.n.13

    Selected

point Noun

Instance: semeval2013.d001.s001.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Baskonia gives away a victory in Israel

Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group.

The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: point
Target surface form: points
Context:
Baskonia gives away a victory in Israel Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 <t>points</t>), they now at the top of their group. The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Candidate senses:
1. sense_key=point%1:09:00:: | definition=a geometric element that has position but no extension | examples=a point is defined by its coordinates
2. sense_key=point%1:15:00:: | definition=the precise location of something; a spatially limited location | examples=she walked to a point where she could survey the whole street
3. sense_key=point%1:10:01:: | definition=a brief version of the essential meaning of something | examples=get to the point; he missed the point of the joke
4. sense_key=point%1:09:01:: | definition=an isolated fact that is considered separately from the whole | synonyms=detail, item | examples=several of the details are similar; a point of information
5. sense_key=point%1:26:00:: | definition=a specific identifiable position in a continuum or series or especially in a process | synonyms=degree, level, stage | examples=a remarkable degree of frankness; at what stage are the social sciences?
6. sense_key=point%1:28:00:: | definition=an instant of time | synonyms=point in time | examples=at that point I had to leave
7. sense_key=point%1:09:02:: | definition=the object of an activity | examples=what is the point of discussing it?
8. sense_key=point%1:25:00:: | definition=a V shape | synonyms=tip, peak | examples=the cannibal's teeth were filed to sharp points
9. sense_key=point%1:25:02:: | definition=a very small circular shape | synonyms=dot | examples=a row of points; draw lines between the dots
10. sense_key=point%1:23:01:: | definition=the unit of counting in scoring a game or contest | examples=he scored 20 points in the first half; a touchdown counts 6 points
11. sense_key=point%1:17:02:: | definition=a promontory extending out into a large body of water | examples=they sailed south around the point
12. sense_key=point%1:10:03:: | definition=a distinct part that can be specified separately in a group of things that could be enumerated on a list | synonyms=item | examples=he noticed an item in the New York Times; she had several items on her shopping list
13. sense_key=point%1:24:04:: | definition=a style in speech or writing that arrests attention and has a penetrating or convincing quality or effect
14. sense_key=point%1:07:01:: | definition=an outstanding characteristic | synonyms=spot | examples=his acting was one of the high points of the movie
15. sense_key=point%1:06:00:: | definition=sharp end | examples=he stuck the point of the knife into a tree; he broke the point of his pencil
16. sense_key=point%1:24:00:: | definition=any of 32 horizontal directions indicated on the card of a compass | synonyms=compass point | examples=he checked the point on his compass
17. sense_key=point%1:23:00:: | definition=a linear unit used to measure the size of type; approximately 1/72 inch
18. sense_key=point%1:21:00:: | definition=one percent of the total principal of a loan; it is paid at the time the loan is made and is independent of the interest on the loan
19. sense_key=point%1:10:00:: | definition=a punctuation mark (.) placed at the end of a declarative sentence to indicate a full stop or after abbreviations | synonyms=period, full stop, stop, full point | examples=in England they call a period a stop
20. sense_key=point%1:10:02:: | definition=a V-shaped mark at one end of an arrow pointer | synonyms=head | examples=the point of the arrow was due north
21. sense_key=point%1:10:04:: | definition=the dot at the left of a decimal fraction | synonyms=decimal point, percentage point
22. sense_key=point%1:07:00:: | definition=the property of a shape that tapers to a sharp tip | synonyms=pointedness
23. sense_key=point%1:07:02:: | definition=a distinguishing or individuating characteristic | examples=he knows my bad points as well as my good points
24. sense_key=point%1:06:02:: | definition=the gun muzzle's direction | synonyms=gunpoint | examples=he held me up at the point of a gun
25. sense_key=point%1:06:01:: | definition=a wall socket | synonyms=power point
26. sense_key=point%1:06:03:: | definition=a contact in the distributor; as the rotor turns its projecting arm contacts them and current flows to the spark plugs | synonyms=distributor point, breaker point

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a geometric element that has position but no extension

    point%1:09:00:: · point.n.01

    • a point is defined by its coordinates
  2. 2

    the precise location of something; a spatially limited location

    point%1:15:00:: · point.n.02

    • she walked to a point where she could survey the whole street
  3. 3

    a brief version of the essential meaning of something

    point%1:10:01:: · point.n.03

    • get to the point
    • he missed the point of the joke
  4. 4

    an isolated fact that is considered separately from the whole

    point%1:09:01:: · detail.n.01

    • several of the details are similar
    • a point of information

    Synonyms: detail, item

  5. 5

    a specific identifiable position in a continuum or series or especially in a process

    point%1:26:00:: · degree.n.02

    • a remarkable degree of frankness
    • at what stage are the social sciences?

    Synonyms: degree, level, stage

  6. 6

    an instant of time

    point%1:28:00:: · point.n.06

    • at that point I had to leave

    Synonyms: point in time

  7. 7

    the object of an activity

    point%1:09:02:: · point.n.07

    • what is the point of discussing it?
  8. 8

    a V shape

    point%1:25:00:: · point.n.08

    • the cannibal's teeth were filed to sharp points

    Synonyms: tip, peak

  9. 9

    a very small circular shape

    point%1:25:02:: · point.n.09

    • a row of points
    • draw lines between the dots

    Synonyms: dot

  10. 10

    the unit of counting in scoring a game or contest

    point%1:23:01:: · point.n.10

    • he scored 20 points in the first half
    • a touchdown counts 6 points
    Gold lexEN Gold Maru 2022 Gold Raganato
  11. 11

    a promontory extending out into a large body of water

    point%1:17:02:: · point.n.11

    • they sailed south around the point
  12. 12

    a distinct part that can be specified separately in a group of things that could be enumerated on a list

    point%1:10:03:: · item.n.01

    • he noticed an item in the New York Times
    • she had several items on her shopping list

    Synonyms: item

  13. 13

    a style in speech or writing that arrests attention and has a penetrating or convincing quality or effect

    point%1:24:04:: · point.n.13

  14. 14

    an outstanding characteristic

    point%1:07:01:: · point.n.14

    • his acting was one of the high points of the movie

    Synonyms: spot

    Selected
  15. 15

    sharp end

    point%1:06:00:: · point.n.15

    • he stuck the point of the knife into a tree
    • he broke the point of his pencil
  16. 16

    any of 32 horizontal directions indicated on the card of a compass

    point%1:24:00:: · compass_point.n.01

    • he checked the point on his compass

    Synonyms: compass point

  17. 17

    a linear unit used to measure the size of type; approximately 1/72 inch

    point%1:23:00:: · point.n.17

  18. 18

    one percent of the total principal of a loan; it is paid at the time the loan is made and is independent of the interest on the loan

    point%1:21:00:: · point.n.18

  19. 19

    a punctuation mark (.) placed at the end of a declarative sentence to indicate a full stop or after abbreviations

    point%1:10:00:: · period.n.07

    • in England they call a period a stop

    Synonyms: period, full stop, stop, full point

  20. 20

    a V-shaped mark at one end of an arrow pointer

    point%1:10:02:: · point.n.20

    • the point of the arrow was due north

    Synonyms: head

  21. 21

    the dot at the left of a decimal fraction

    point%1:10:04:: · decimal_point.n.01

    Synonyms: decimal point, percentage point

  22. 22

    the property of a shape that tapers to a sharp tip

    point%1:07:00:: · point.n.22

    Synonyms: pointedness

  23. 23

    a distinguishing or individuating characteristic

    point%1:07:02:: · point.n.23

    • he knows my bad points as well as my good points
  24. 24

    the gun muzzle's direction

    point%1:06:02:: · point.n.24

    • he held me up at the point of a gun

    Synonyms: gunpoint

  25. 25

    a wall socket

    point%1:06:01:: · point.n.25

    Synonyms: power point

  26. 26

    a contact in the distributor; as the rotor turns its projecting arm contacts them and current flows to the spark plugs

    point%1:06:03:: · distributor_point.n.01

    Synonyms: distributor point, breaker point

end Noun

Instance: semeval2013.d001.s002.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Baskonia gives away a victory in Israel

Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group.

The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: end
Target surface form: end
Context:
Baskonia gives away a victory in Israel Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group. The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the <t>end</t> to take the victory. Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph.

Candidate senses:
1. sense_key=end%1:15:00:: | definition=either extremity of something that has length | synonyms=terminal | examples=the end of the pier; she knotted the end of the thread
2. sense_key=end%1:28:00:: | definition=the point in time at which something ends | synonyms=ending | examples=the end of the year; the ending of warranty period
3. sense_key=end%1:11:00:: | definition=the concluding parts of an event or occurrence | synonyms=last, final stage | examples=the end was exciting; I had to miss the last of the movie
4. sense_key=end%1:09:02:: | definition=the state of affairs that a plan is intended to achieve and that (when achieved) terminates behavior intended to achieve it | synonyms=goal | examples=the ends justify the means
5. sense_key=end%1:09:00:: | definition=a final part or section | examples=we have given it at the end of the section since it involves the calculus; Start at the beginning and go on until you come to the end
6. sense_key=end%1:26:00:: | definition=a final state | synonyms=destruction, death | examples=he came to a bad end; the so-called glorious experiment came to an inglorious end
7. sense_key=end%1:15:02:: | definition=the surface at either extremity of a three-dimensional object | examples=one end of the box was marked `This side up'
8. sense_key=end%1:18:00:: | definition=(football) the person who plays at one end of the line of scrimmage | examples=the end managed to hold onto the pass
9. sense_key=end%1:15:01:: | definition=a boundary marking the extremities of something | examples=the end of town
10. sense_key=end%1:15:03:: | definition=one of two places from which people are communicating to each other | examples=the phone rang at the other end; both ends wrote at the same time
11. sense_key=end%1:04:00:: | definition=the part you are expected to play | examples=he held up his end
12. sense_key=end%1:10:00:: | definition=the last section of a communication | synonyms=conclusion, close, closing, ending | examples=in conclusion I want to say...
13. sense_key=end%1:06:02:: | definition=a piece of cloth that is left over after the rest has been used or sold | synonyms=remainder, remnant, oddment
14. sense_key=end%1:04:02:: | definition=(American football) a position on the line of scrimmage | examples=no one wanted to play end

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    either extremity of something that has length

    end%1:15:00:: · end.n.01

    • the end of the pier
    • she knotted the end of the thread

    Synonyms: terminal

  2. 2

    the point in time at which something ends

    end%1:28:00:: · end.n.02

    • the end of the year
    • the ending of warranty period

    Synonyms: ending

    Gold lexEN Gold Maru 2022
  3. 3

    the concluding parts of an event or occurrence

    end%1:11:00:: · end.n.03

    • the end was exciting
    • I had to miss the last of the movie

    Synonyms: last, final stage

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    the state of affairs that a plan is intended to achieve and that (when achieved) terminates behavior intended to achieve it

    end%1:09:02:: · goal.n.01

    • the ends justify the means

    Synonyms: goal

  5. 5

    a final part or section

    end%1:09:00:: · end.n.05

    • we have given it at the end of the section since it involves the calculus
    • Start at the beginning and go on until you come to the end
    Gold lexEN Gold Maru 2022
  6. 6

    a final state

    end%1:26:00:: · end.n.06

    • he came to a bad end
    • the so-called glorious experiment came to an inglorious end

    Synonyms: destruction, death

  7. 7

    the surface at either extremity of a three-dimensional object

    end%1:15:02:: · end.n.07

    • one end of the box was marked `This side up'
  8. 8

    (football) the person who plays at one end of the line of scrimmage

    end%1:18:00:: · end.n.08

    • the end managed to hold onto the pass
  9. 9

    a boundary marking the extremities of something

    end%1:15:01:: · end.n.09

    • the end of town
  10. 10

    one of two places from which people are communicating to each other

    end%1:15:03:: · end.n.10

    • the phone rang at the other end
    • both ends wrote at the same time
  11. 11

    the part you are expected to play

    end%1:04:00:: · end.n.11

    • he held up his end
  12. 12

    the last section of a communication

    end%1:10:00:: · conclusion.n.08

    • in conclusion I want to say...

    Synonyms: conclusion, close, closing, ending

    Selected
  13. 13

    a piece of cloth that is left over after the rest has been used or sold

    end%1:06:02:: · end.n.13

    Synonyms: remainder, remnant, oddment

  14. 14

    (American football) a position on the line of scrimmage

    end%1:04:02:: · end.n.14

    • no one wanted to play end

end Noun

Instance: semeval2013.d001.s006.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group.

The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph.

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: end
Target surface form: end
Context:
Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group. The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory. Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph. The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the <t>end</t> of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Candidate senses:
1. sense_key=end%1:15:00:: | definition=either extremity of something that has length | synonyms=terminal | examples=the end of the pier; she knotted the end of the thread
2. sense_key=end%1:28:00:: | definition=the point in time at which something ends | synonyms=ending | examples=the end of the year; the ending of warranty period
3. sense_key=end%1:11:00:: | definition=the concluding parts of an event or occurrence | synonyms=last, final stage | examples=the end was exciting; I had to miss the last of the movie
4. sense_key=end%1:09:02:: | definition=the state of affairs that a plan is intended to achieve and that (when achieved) terminates behavior intended to achieve it | synonyms=goal | examples=the ends justify the means
5. sense_key=end%1:09:00:: | definition=a final part or section | examples=we have given it at the end of the section since it involves the calculus; Start at the beginning and go on until you come to the end
6. sense_key=end%1:26:00:: | definition=a final state | synonyms=destruction, death | examples=he came to a bad end; the so-called glorious experiment came to an inglorious end
7. sense_key=end%1:15:02:: | definition=the surface at either extremity of a three-dimensional object | examples=one end of the box was marked `This side up'
8. sense_key=end%1:18:00:: | definition=(football) the person who plays at one end of the line of scrimmage | examples=the end managed to hold onto the pass
9. sense_key=end%1:15:01:: | definition=a boundary marking the extremities of something | examples=the end of town
10. sense_key=end%1:15:03:: | definition=one of two places from which people are communicating to each other | examples=the phone rang at the other end; both ends wrote at the same time
11. sense_key=end%1:04:00:: | definition=the part you are expected to play | examples=he held up his end
12. sense_key=end%1:10:00:: | definition=the last section of a communication | synonyms=conclusion, close, closing, ending | examples=in conclusion I want to say...
13. sense_key=end%1:06:02:: | definition=a piece of cloth that is left over after the rest has been used or sold | synonyms=remainder, remnant, oddment
14. sense_key=end%1:04:02:: | definition=(American football) a position on the line of scrimmage | examples=no one wanted to play end

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    either extremity of something that has length

    end%1:15:00:: · end.n.01

    • the end of the pier
    • she knotted the end of the thread

    Synonyms: terminal

  2. 2

    the point in time at which something ends

    end%1:28:00:: · end.n.02

    • the end of the year
    • the ending of warranty period

    Synonyms: ending

    Gold lexEN Gold Maru 2022
  3. 3

    the concluding parts of an event or occurrence

    end%1:11:00:: · end.n.03

    • the end was exciting
    • I had to miss the last of the movie

    Synonyms: last, final stage

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    the state of affairs that a plan is intended to achieve and that (when achieved) terminates behavior intended to achieve it

    end%1:09:02:: · goal.n.01

    • the ends justify the means

    Synonyms: goal

  5. 5

    a final part or section

    end%1:09:00:: · end.n.05

    • we have given it at the end of the section since it involves the calculus
    • Start at the beginning and go on until you come to the end
    Gold lexEN Gold Maru 2022
  6. 6

    a final state

    end%1:26:00:: · end.n.06

    • he came to a bad end
    • the so-called glorious experiment came to an inglorious end

    Synonyms: destruction, death

  7. 7

    the surface at either extremity of a three-dimensional object

    end%1:15:02:: · end.n.07

    • one end of the box was marked `This side up'
  8. 8

    (football) the person who plays at one end of the line of scrimmage

    end%1:18:00:: · end.n.08

    • the end managed to hold onto the pass
  9. 9

    a boundary marking the extremities of something

    end%1:15:01:: · end.n.09

    • the end of town
  10. 10

    one of two places from which people are communicating to each other

    end%1:15:03:: · end.n.10

    • the phone rang at the other end
    • both ends wrote at the same time
  11. 11

    the part you are expected to play

    end%1:04:00:: · end.n.11

    • he held up his end
  12. 12

    the last section of a communication

    end%1:10:00:: · conclusion.n.08

    • in conclusion I want to say...

    Synonyms: conclusion, close, closing, ending

    Selected
  13. 13

    a piece of cloth that is left over after the rest has been used or sold

    end%1:06:02:: · end.n.13

    Synonyms: remainder, remnant, oddment

  14. 14

    (American football) a position on the line of scrimmage

    end%1:04:02:: · end.n.14

    • no one wanted to play end

return Noun

Instance: semeval2013.d001.s007.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph.

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: return
Target surface form: return
Context:
The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory. Additionally, their huge success from the sidelines, with 16 three pointers scored, had a lot to do with the final triumph. The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his <t>return</t> home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

Candidate senses:
1. sense_key=return%1:10:01:: | definition=document giving the tax collector information about the taxpayer's tax liability | synonyms=tax return, income tax return | examples=his gross income was enough that he had to file a tax return
2. sense_key=return%1:04:01:: | definition=a coming to or returning home | synonyms=homecoming | examples=on his return from Australia we gave him a welcoming party
3. sense_key=return%1:11:02:: | definition=the occurrence of a change in direction back in the opposite direction | synonyms=coming back
4. sense_key=return%1:04:02:: | definition=getting something back again | synonyms=restitution, restoration, regaining | examples=upon the restitution of the book to its rightful owner the child was given a tongue lashing
5. sense_key=return%1:04:00:: | definition=the act of going back to a prior location | examples=they set out on their return to the base camp
6. sense_key=return%1:21:00:: | definition=the income or profit arising from such transactions as the sale of land or other property | synonyms=issue, take, takings, proceeds, yield, payoff | examples=the average return was about 5%
7. sense_key=return%1:11:01:: | definition=happening again (especially at regular intervals) | synonyms=recurrence | examples=the return of spring
8. sense_key=return%1:10:02:: | definition=a quick reply to a question or remark (especially a witty or critical one) | synonyms=rejoinder, retort, riposte, replication, comeback, counter | examples=it brought a sharp rejoinder from the teacher
9. sense_key=return%1:06:00:: | definition=the key on electric typewriters or computer keyboards that causes a carriage return and a line feed | synonyms=return key
10. sense_key=return%1:04:06:: | definition=a reciprocal group action | synonyms=paying back, getting even | examples=in return we gave them as good as we got
11. sense_key=return%1:04:04:: | definition=a tennis stroke that sends the ball back to the other player | examples=he won the point on a cross-court return
12. sense_key=return%1:04:05:: | definition=(American football) the act of running back the ball after a kickoff or punt or interception or fumble
13. sense_key=return%1:04:07:: | definition=the act of someone appearing again | synonyms=reappearance | examples=his reappearance as Hamlet has been long awaited

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    document giving the tax collector information about the taxpayer's tax liability

    return%1:10:01:: · tax_return.n.01

    • his gross income was enough that he had to file a tax return

    Synonyms: tax return, income tax return

  2. 2

    a coming to or returning home

    return%1:04:01:: · return.n.02

    • on his return from Australia we gave him a welcoming party

    Synonyms: homecoming

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    the occurrence of a change in direction back in the opposite direction

    return%1:11:02:: · return.n.03

    Synonyms: coming back

  4. 4

    getting something back again

    return%1:04:02:: · restitution.n.03

    • upon the restitution of the book to its rightful owner the child was given a tongue lashing

    Synonyms: restitution, restoration, regaining

  5. 5

    the act of going back to a prior location

    return%1:04:00:: · return.n.05

    • they set out on their return to the base camp
    Gold lexEN Gold Maru 2022
  6. 6

    the income or profit arising from such transactions as the sale of land or other property

    return%1:21:00:: · return.n.06

    • the average return was about 5%

    Synonyms: issue, take, takings, proceeds, yield, payoff

  7. 7

    happening again (especially at regular intervals)

    return%1:11:01:: · recurrence.n.01

    • the return of spring

    Synonyms: recurrence

  8. 8

    a quick reply to a question or remark (especially a witty or critical one)

    return%1:10:02:: · rejoinder.n.01

    • it brought a sharp rejoinder from the teacher

    Synonyms: rejoinder, retort, riposte, replication, comeback, counter

  9. 9

    the key on electric typewriters or computer keyboards that causes a carriage return and a line feed

    return%1:06:00:: · return_key.n.01

    Synonyms: return key

  10. 10

    a reciprocal group action

    return%1:04:06:: · return.n.10

    • in return we gave them as good as we got

    Synonyms: paying back, getting even

  11. 11

    a tennis stroke that sends the ball back to the other player

    return%1:04:04:: · return.n.11

    • he won the point on a cross-court return
    Selected
  12. 12

    (American football) the act of running back the ball after a kickoff or punt or interception or fumble

    return%1:04:05:: · return.n.12

  13. 13

    the act of someone appearing again

    return%1:04:07:: · reappearance.n.02

    • his reappearance as Hamlet has been long awaited

    Synonyms: reappearance

game Noun

Instance: semeval2013.d001.s009.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start.

As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists.

English and Teletovic were the main scorers of the 18-20 at the end of the first period.

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian.

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: game
Target surface form: game
Context:
The game started out in favor of the Azulgranas, who put themselves ahead on the scoreboard from the start. As Vitora's first four baskets were from the perimeter, the speculation was already that they had jumped into the Israeli net with hot wrists. English and Teletovic were the main scorers of the 18-20 at the end of the first period. The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43). Teletovic had already begun to stand out as the best on his team with 13 points, even though Splitter's "six fewer" points already signaled that it wasn't going to be the best night for the Brazilian. But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the <t>game</t>. Eidson and Pnini played a decisive role in the "yellows'" return to the light.

Candidate senses:
1. sense_key=game%1:04:00:: | definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. sense_key=game%1:04:03:: | definition=a single play of a sport or other contest | examples=the game lasted two hours
3. sense_key=game%1:04:01:: | definition=an amusement or pastime | examples=they played word games; he thought of his painting as a game that filled his empty time
4. sense_key=game%1:05:00:: | definition=animal hunted for food or sport
5. sense_key=game%1:28:00:: | definition=(tennis) a division of play during which one player serves
6. sense_key=game%1:23:00:: | definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all; he is serving for the game
7. sense_key=game%1:13:00:: | definition=the flesh of wild animals that is used for food
8. sense_key=game%1:09:00:: | definition=a secret scheme to do something (especially something underhand or illegal) | synonyms=plot, secret plan | examples=they concocted a plot to discredit the governor; I saw through his little game from the start
9. sense_key=game%1:06:00:: | definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. sense_key=game%1:04:02:: | definition=your occupation or line of work | synonyms=biz | examples=he's in the plumbing game; she's in show biz
11. sense_key=game%1:04:04:: | definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game; for him, life is all fun and games

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

figure Noun

Instance: semeval2013.d002.s002.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Wall Street closes without momentum, slowed by a strengthening dollar

The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%.

According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: figure
Target surface form: figures
Context:
Wall Street closes without momentum, slowed by a strengthening dollar The New York Stock Exchange closed with no particular heading on Friday, in a market torn between better than expected indicators in the United States and a strengthening dollar: the Dow Jones gained 0.63% but the NASDAQ dropped 0.03%. According to final closing <t>figures</t>, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points. The wider Standard &amp; Poor's 500 has itself advanced by 0.37% (4.06 points) to 1 106.41 points.

Candidate senses:
1. sense_key=figure%1:10:00:: | definition=a diagram or picture illustrating textual material | synonyms=fig | examples=the area covered can be seen from Figure 2
2. sense_key=figure%1:08:00:: | definition=alternative names for the body of a human being | synonyms=human body, physical body, material body, soma, build, physique | examples=Leonardo studied the human body; he has a strong physique
3. sense_key=figure%1:23:00:: | definition=one of the elements that collectively form a system of numeration | synonyms=digit | examples=0 and 1 are digits
4. sense_key=figure%1:06:00:: | definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
5. sense_key=figure%1:18:00:: | definition=a well-known or notable person | synonyms=name, public figure | examples=they studied all the great names in the history of France; she is an important figure in modern music
6. sense_key=figure%1:25:00:: | definition=a combination of points and lines and planes that form a visible palpable shape
7. sense_key=figure%1:21:00:: | definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
8. sense_key=figure%1:07:00:: | definition=the impression produced by a person | examples=he cut a fine figure; a heroic figure
9. sense_key=figure%1:07:01:: | definition=the property possessed by a sum or total or indefinite quantity of units or individuals | synonyms=number | examples=he had a number of chores to do; the number of parameters is small
10. sense_key=figure%1:10:01:: | definition=language used in a figurative or nonliteral sense | synonyms=trope, figure of speech, image
11. sense_key=figure%1:09:00:: | definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground
12. sense_key=figure%1:06:01:: | definition=a decorative or artistic work | synonyms=design, pattern | examples=the coach had a design on the doors
13. sense_key=figure%1:04:00:: | definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  2. 2

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  3. 3

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  4. 4

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  5. 5

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  6. 6

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

  7. 7

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
    Selected
  8. 8

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  9. 9

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  11. 11

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

  12. 12

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  13. 13

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures

support Noun

Instance: semeval2013.d004.s000.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

US banks repay state support

The crisis-hit US major banks are breaking free from their state shackles.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: support
Target surface form: support
Context:
US banks repay state <t>support</t> The crisis-hit US major banks are breaking free from their state shackles.

Candidate senses:
1. sense_key=support%1:04:04:: | definition=the activity of providing for or maintaining by supplying with money or necessities | examples=his support kept the family together; they gave him emotional support during difficult times
2. sense_key=support%1:04:00:: | definition=aiding the cause or policy or interests of | examples=the president no longer has the support of his own party; they developed a scheme of mutual support
3. sense_key=support%1:09:00:: | definition=something providing immaterial assistance to a person or cause or interest | examples=the policy found little public support; his faith was all the support he needed
4. sense_key=support%1:04:03:: | definition=a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission | synonyms=reinforcement, reenforcement | examples=they called for artillery support
5. sense_key=support%1:04:02:: | definition=documentary validation | synonyms=documentation | examples=his documentation of the results was excellent; the strongest support for this view is the work of Jones
6. sense_key=support%1:21:00:: | definition=the financial means whereby one lives | synonyms=keep, livelihood, living, bread and butter, sustenance | examples=each child was expected to pay for their keep; he applied to the state for support
7. sense_key=support%1:06:01:: | definition=supporting structure that holds up or provides a foundation | examples=the statue stood on a marble support
8. sense_key=support%1:04:01:: | definition=the act of bearing the weight of or strengthening | synonyms=supporting | examples=he leaned against the wall for support
9. sense_key=support%1:10:01:: | definition=a musical part (vocal or instrumental) that supports or provides background for other musical parts | synonyms=accompaniment, musical accompaniment, backup
10. sense_key=support%1:06:00:: | definition=any device that bears the weight of another thing | examples=there was no place to attach supports for a shelf
11. sense_key=support%1:21:01:: | definition=financial resources provided to make some project possible | synonyms=financial support, funding, backing, financial backing | examples=the foundation provided support for the experiment

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the activity of providing for or maintaining by supplying with money or necessities

    support%1:04:04:: · support.n.01

    • his support kept the family together
    • they gave him emotional support during difficult times
  2. 2

    aiding the cause or policy or interests of

    support%1:04:00:: · support.n.02

    • the president no longer has the support of his own party
    • they developed a scheme of mutual support
    Selected
  3. 3

    something providing immaterial assistance to a person or cause or interest

    support%1:09:00:: · support.n.03

    • the policy found little public support
    • his faith was all the support he needed
  4. 4

    a military operation (often involving new supplies of men and materiel) to strengthen a military force or aid in the performance of its mission

    support%1:04:03:: · support.n.04

    • they called for artillery support

    Synonyms: reinforcement, reenforcement

  5. 5

    documentary validation

    support%1:04:02:: · documentation.n.03

    • his documentation of the results was excellent
    • the strongest support for this view is the work of Jones

    Synonyms: documentation

  6. 6

    the financial means whereby one lives

    support%1:21:00:: · support.n.06

    • each child was expected to pay for their keep
    • he applied to the state for support

    Synonyms: keep, livelihood, living, bread and butter, sustenance

  7. 7

    supporting structure that holds up or provides a foundation

    support%1:06:01:: · support.n.07

    • the statue stood on a marble support
  8. 8

    the act of bearing the weight of or strengthening

    support%1:04:01:: · support.n.08

    • he leaned against the wall for support

    Synonyms: supporting

  9. 9

    a musical part (vocal or instrumental) that supports or provides background for other musical parts

    support%1:10:01:: · accompaniment.n.02

    Synonyms: accompaniment, musical accompaniment, backup

  10. 10

    any device that bears the weight of another thing

    support%1:06:00:: · support.n.10

    • there was no place to attach supports for a shelf
  11. 11

    financial resources provided to make some project possible

    support%1:21:01:: · support.n.11

    • the foundation provided support for the experiment

    Synonyms: financial support, funding, backing, financial backing

    Gold lexEN Gold Maru 2022 Gold Raganato

defense Noun

Instance: semeval2013.d005.s003.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Cheshire Appeal Will Point to Twitter

There were half a dozen of them typing away in the courtroom rows.

Minute by minute, they sent out reports of gruesome testimony via Twitter.

In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze.

On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: defense
Target surface form: defense
Context:
Cheshire Appeal Will Point to Twitter There were half a dozen of them typing away in the courtroom rows. Minute by minute, they sent out reports of gruesome testimony via Twitter. In the end, the <t>defense</t> says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze. On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury.

Candidate senses:
1. sense_key=defense%1:04:00:: | definition=(military) military action or resources protecting a country against potential enemies | synonyms=defence, defensive measure | examples=they died in the defense of Stalingrad; they were developed for the defense program
2. sense_key=defense%1:04:03:: | definition=protection from harm | synonyms=defence | examples=sanitation is the best defense against disease
3. sense_key=defense%1:14:01:: | definition=(sports) the team that is trying to prevent the other team from scoring | synonyms=defence, defending team | examples=his teams are always good on defense
4. sense_key=defense%1:10:00:: | definition=the justification for some act or belief | synonyms=defence, vindication | examples=he offered a persuasive defense of the theory
5. sense_key=defense%1:22:00:: | definition=(psychiatry) an unconscious process that tries to reduce the anxiety associated with instinctive desires | synonyms=defense mechanism, defense reaction, defence mechanism, defence reaction, defence
6. sense_key=defense%1:14:02:: | definition=the federal department responsible for safeguarding national security of the United States; created in 1947 | synonyms=Department of Defense, Defense Department, United States Department of Defense, DoD
7. sense_key=defense%1:14:00:: | definition=the defendant and his legal advisors collectively | synonyms=defence, defense team, defense lawyers | examples=the defense called for a mistrial
8. sense_key=defense%1:10:01:: | definition=the speech act of answering an attack on your assertions | synonyms=refutation, defence | examples=his refutation of the charges was short and persuasive; in defense he said the other man started it
9. sense_key=defense%1:14:03:: | definition=an organization of defenders that provides resistance against attack | synonyms=defence, defense force, defence force | examples=he joined the defense against invasion
10. sense_key=defense%1:06:00:: | definition=a structure used to defend against attack | synonyms=defensive structure, defence | examples=the artillery battered down the defenses
11. sense_key=defense%1:04:02:: | definition=a defendant's answer or plea denying the truth of the charges against him | synonyms=defence, denial, demurrer | examples=he gave evidence for the defense
12. sense_key=defense%1:04:01:: | definition=the act of defending someone or something against attack or injury | synonyms=defence | examples=a good boxer needs a good defense; defense against hurricanes is an urgent problem

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    (military) military action or resources protecting a country against potential enemies

    defense%1:04:00:: · defense.n.01

    • they died in the defense of Stalingrad
    • they were developed for the defense program

    Synonyms: defence, defensive measure

  2. 2

    protection from harm

    defense%1:04:03:: · defense.n.02

    • sanitation is the best defense against disease

    Synonyms: defence

  3. 3

    (sports) the team that is trying to prevent the other team from scoring

    defense%1:14:01:: · defense.n.03

    • his teams are always good on defense

    Synonyms: defence, defending team

  4. 4

    the justification for some act or belief

    defense%1:10:00:: · defense.n.04

    • he offered a persuasive defense of the theory

    Synonyms: defence, vindication

  5. 5

    (psychiatry) an unconscious process that tries to reduce the anxiety associated with instinctive desires

    defense%1:22:00:: · defense_mechanism.n.01

    Synonyms: defense mechanism, defense reaction, defence mechanism, defence reaction, defence

  6. 6

    the federal department responsible for safeguarding national security of the United States; created in 1947

    defense%1:14:02:: · department_of_defense.n.01

    Synonyms: Department of Defense, Defense Department, United States Department of Defense, DoD

  7. 7

    the defendant and his legal advisors collectively

    defense%1:14:00:: · defense.n.07

    • the defense called for a mistrial

    Synonyms: defence, defense team, defense lawyers

    Gold lexEN Gold Maru 2022 Gold Raganato
  8. 8

    the speech act of answering an attack on your assertions

    defense%1:10:01:: · refutation.n.01

    • his refutation of the charges was short and persuasive
    • in defense he said the other man started it

    Synonyms: refutation, defence

  9. 9

    an organization of defenders that provides resistance against attack

    defense%1:14:03:: · defense.n.09

    • he joined the defense against invasion

    Synonyms: defence, defense force, defence force

  10. 10

    a structure used to defend against attack

    defense%1:06:00:: · defensive_structure.n.01

    • the artillery battered down the defenses

    Synonyms: defensive structure, defence

  11. 11

    a defendant's answer or plea denying the truth of the charges against him

    defense%1:04:02:: · defense.n.11

    • he gave evidence for the defense

    Synonyms: defence, denial, demurrer

  12. 12

    the act of defending someone or something against attack or injury

    defense%1:04:01:: · defense.n.12

    • a good boxer needs a good defense
    • defense against hurricanes is an urgent problem

    Synonyms: defence

    Selected

house Noun

Instance: semeval2013.d005.s003.t007 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Cheshire Appeal Will Point to Twitter

There were half a dozen of them typing away in the courtroom rows.

Minute by minute, they sent out reports of gruesome testimony via Twitter.

In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze.

On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: house
Target surface form: house
Context:
Cheshire Appeal Will Point to Twitter There were half a dozen of them typing away in the courtroom rows. Minute by minute, they sent out reports of gruesome testimony via Twitter. In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a <t>house</t> that was set ablaze. On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury.

Candidate senses:
1. sense_key=house%1:06:00:: | definition=a dwelling that serves as living quarters for one or more families | examples=he has a house on Cape Cod; she felt she had to get out of the house
2. sense_key=house%1:14:01:: | definition=the members of a business organization that owns or operates one or more establishments | synonyms=firm, business firm | examples=he worked for a brokerage house
3. sense_key=house%1:14:04:: | definition=the members of a religious community living together
4. sense_key=house%1:14:03:: | definition=the audience gathered together in a theatre or cinema | examples=the house applauded; he counted the house
5. sense_key=house%1:14:02:: | definition=an official assembly having legislative powers | examples=a bicameral legislature has two houses
6. sense_key=house%1:14:00:: | definition=aristocratic family line | examples=the House of York
7. sense_key=house%1:04:00:: | definition=play in which children take the roles of father or mother or children and pretend to interact like adults | examples=the children were playing house
8. sense_key=house%1:15:00:: | definition=(astrology) one of 12 equal areas into which the zodiac is divided | synonyms=sign of the zodiac, star sign, sign, mansion, planetary house
9. sense_key=house%1:14:06:: | definition=the management of a gambling house or casino | examples=the house gets a percentage of every bet
10. sense_key=house%1:14:05:: | definition=a social unit living together | synonyms=family, household, home, menage | examples=he moved his family to Virginia; It was a good Christian household
11. sense_key=house%1:06:02:: | definition=a building where theatrical performances or motion-picture shows can be presented | synonyms=theater, theatre | examples=the house was full
12. sense_key=house%1:06:01:: | definition=a building in which something is sheltered or located | examples=they had a large carriage house

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a dwelling that serves as living quarters for one or more families

    house%1:06:00:: · house.n.01

    • he has a house on Cape Cod
    • she felt she had to get out of the house
    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    the members of a business organization that owns or operates one or more establishments

    house%1:14:01:: · firm.n.01

    • he worked for a brokerage house

    Synonyms: firm, business firm

  3. 3

    the members of a religious community living together

    house%1:14:04:: · house.n.03

  4. 4

    the audience gathered together in a theatre or cinema

    house%1:14:03:: · house.n.04

    • the house applauded
    • he counted the house
  5. 5

    an official assembly having legislative powers

    house%1:14:02:: · house.n.05

    • a bicameral legislature has two houses
  6. 6

    aristocratic family line

    house%1:14:00:: · house.n.06

    • the House of York
  7. 7

    play in which children take the roles of father or mother or children and pretend to interact like adults

    house%1:04:00:: · house.n.07

    • the children were playing house
  8. 8

    (astrology) one of 12 equal areas into which the zodiac is divided

    house%1:15:00:: · sign_of_the_zodiac.n.01

    Synonyms: sign of the zodiac, star sign, sign, mansion, planetary house

  9. 9

    the management of a gambling house or casino

    house%1:14:06:: · house.n.09

    • the house gets a percentage of every bet
  10. 10

    a social unit living together

    house%1:14:05:: · family.n.01

    • he moved his family to Virginia
    • It was a good Christian household

    Synonyms: family, household, home, menage

    Selected
  11. 11

    a building where theatrical performances or motion-picture shows can be presented

    house%1:06:02:: · theater.n.01

    • the house was full

    Synonyms: theater, theatre

  12. 12

    a building in which something is sheltered or located

    house%1:06:01:: · house.n.12

    • they had a large carriage house

court Noun

Instance: semeval2013.d005.s005.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Cheshire Appeal Will Point to Twitter

There were half a dozen of them typing away in the courtroom rows.

Minute by minute, they sent out reports of gruesome testimony via Twitter.

In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze.

On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury.

But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years.

One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: court
Target surface form: courts
Context:
Cheshire Appeal Will Point to Twitter There were half a dozen of them typing away in the courtroom rows. Minute by minute, they sent out reports of gruesome testimony via Twitter. In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze. On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury. But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the <t>courts</t> for years. One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions.

Candidate senses:
1. sense_key=court%1:14:00:: | definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. sense_key=court%1:06:02:: | definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. sense_key=court%1:14:01:: | definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. sense_key=court%1:06:01:: | definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. sense_key=court%1:18:00:: | definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. sense_key=court%1:14:02:: | definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. sense_key=court%1:06:03:: | definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. sense_key=court%1:06:05:: | definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. sense_key=court%1:06:04:: | definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. sense_key=court%1:06:00:: | definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. sense_key=court%1:04:00:: | definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

    Selected
  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage