SenseBench

Verified run

gpt-4.1-nano

gpt-4.1-nano-p002-lexen-v1-20260614

Rank
165
Accuracy lexEN v1 · WordNet fine
73.28%
Correct
3562 / 4861
Actual run cost
$0.114
Cost / M items
$23.50

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 73.28% 3562 / 4861 86.48% 4204 / 4861 82.29% 4000 / 4861
Maru 2022 (ALLamended) 72.33% 3516 / 4861 86.20% 4190 / 4861 81.69% 3971 / 4861
Raganato 2017 (original) 67.70% 3291 / 4861 84.49% 4107 / 4861 78.79% 3830 / 4861

Model

Display
gpt-4.1-nano
Requested
gpt-4.1-nano
Resolved
gpt-4.1-nano-2025-04-14
Vendor
OpenAI
API provider
OpenAI
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
n/a
Model URL
n/a
Endpoint
n/a
Resolved counts
gpt-4.1-nano-2025-04-14: 4861

Reproducibility

Created
2026-06-14T03:11:19.453636+00:00
Run schema
sensebench-run-v2
Commit
78aebb2a6fd1412a1e8eab85f6209a64f8f441e8
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p002
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
1,127,609
Tokens / item
232.0
Total cost
$0.114
Cost / M items
$23.50
Cost source
litellm_estimate
Elapsed
15.17s
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
256
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.114. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 1,122,748 $0.112 $0.100
Input cached 0 $0.00 $0.0250
Output 4,861 $0.00194 $0.400
Reasoning output 0 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Run Metadata run.json Submitted run.json with model, dataset, prompt, policy, totals, and costs. 2.3 KB Predictions predictions.jsonl One JSON record per benchmark item with candidates, votes, and correctness. 5.9 MB Raw Calls calls.jsonl.gz Gzipped JSONL call log with prompts, raw outputs, token usage, and costs. 1.5 MB

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 59.07% 469 794
Candidate Count 2 83.51% 714 855
Candidate Count 3-5 77.99% 1517 1945
Candidate Count 6-10 68.03% 862 1267
POS ADJ 78.60% 518 659
POS ADV 69.74% 136 195
POS NOUN 75.66% 2192 2897
POS VERB 64.50% 716 1110
Source Dataset semeval2013 74.21% 846 1140
Source Dataset semeval2015 74.83% 553 739
Source Dataset senseval2 73.60% 1199 1629
Source Dataset senseval3 71.25% 964 1353

Worst-Bucket Examples

cut Noun

Instance: semeval2013.d000.s012.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

U.S. special climate envoy Todd Stern rejected language requiring binding cuts of greenhouse-gas emissions for industrialized countries compared with voluntary ones by major emerging economies if they were not funded by the developed world.

Show raw prompt

user

Which numbered sense of "cut" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: U.S. special climate envoy Todd Stern rejected language requiring binding <t>cuts</t> of greenhouse-gas emissions for industrialized countries compared with voluntary ones by major emerging economies if they were not funded by the developed world.

Senses:
1. definition=a share of the profits | examples=everyone got a cut of the earnings
2. definition=(film) an immediate transition from one shot to the next | examples=the cut from the accident scene to the hospital seemed too abrupt
3. definition=a trench resembling a furrow that was made by erosion or excavation
4. definition=a step on some scale | examples=he is a cut above the rest
5. definition=a wound made by cutting | examples=he put a bandage over the cut
6. definition=a piece of meat that has been cut from an animal carcass
7. definition=a remark capable of wounding mentally | examples=the unkindest cut of all
8. definition=a distinct selection of music from a recording or a compact disc | examples=he played the first cut on the cd
9. definition=the omission that is made when an editorial change shortens a written passage | examples=an editor's deletions frequently upset young authors
10. definition=the style in which a garment is cut | examples=a dress of traditional cut
11. definition=a canal made by erosion or excavation
12. definition=a refusal to recognize someone you know | examples=the snub was clearly intentional
13. definition=in baseball; a batter's attempt to hit a pitched ball | examples=he took a vicious cut at the ball
14. definition=(sports) a stroke that puts reverse spin on the ball | examples=cuts do not bother a good tennis player
15. definition=the division of a deck of cards before dealing | examples=he insisted that we give him the last cut before every deal
16. definition=the act of penetrating or opening open with a sharp edge | examples=his cut in the lining revealed the hidden jewels
17. definition=the act of cutting something into parts | examples=his cuts were skillful
18. definition=the act of shortening something by chopping off the ends | examples=the barber gave him a good cut
19. definition=the act of reducing the amount or number | examples=the mayor proposed extensive cuts in the city budget
20. definition=an unexcused absence from class | examples=he was punished for taking too many cuts in his math class

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a share of the profits

    cut%1:21:00:: · cut.n.01

    • everyone got a cut of the earnings
  2. 2

    (film) an immediate transition from one shot to the next

    cut%1:10:00:: · cut.n.02

    • the cut from the accident scene to the hospital seemed too abrupt
  3. 3

    a trench resembling a furrow that was made by erosion or excavation

    cut%1:06:00:: · cut.n.03

    Synonyms: gash

  4. 4

    a step on some scale

    cut%1:26:01:: · cut.n.04

    • he is a cut above the rest
  5. 5

    a wound made by cutting

    cut%1:26:00:: · cut.n.05

    • he put a bandage over the cut

    Synonyms: gash, slash, slice

    Selected
  6. 6

    a piece of meat that has been cut from an animal carcass

    cut%1:13:00:: · cut.n.06

    Synonyms: cut of meat

  7. 7

    a remark capable of wounding mentally

    cut%1:10:02:: · stinger.n.02

    • the unkindest cut of all

    Synonyms: stinger

  8. 8

    a distinct selection of music from a recording or a compact disc

    cut%1:10:04:: · cut.n.08

    • he played the first cut on the cd
    • the title track of the album

    Synonyms: track

  9. 9

    the omission that is made when an editorial change shortens a written passage

    cut%1:10:01:: · deletion.n.03

    • an editor's deletions frequently upset young authors
    • both parties agreed on the excision of the proposed clause

    Synonyms: deletion, excision

  10. 10

    the style in which a garment is cut

    cut%1:09:00:: · cut.n.10

    • a dress of traditional cut
  11. 11

    a canal made by erosion or excavation

    cut%1:06:01:: · cut.n.11

  12. 12

    a refusal to recognize someone you know

    cut%1:04:03:: · snub.n.02

    • the snub was clearly intentional

    Synonyms: snub, cold shoulder

  13. 13

    in baseball; a batter's attempt to hit a pitched ball

    cut%1:04:07:: · baseball_swing.n.01

    • he took a vicious cut at the ball

    Synonyms: baseball swing, swing

  14. 14

    (sports) a stroke that puts reverse spin on the ball

    cut%1:04:08:: · cut.n.14

    • cuts do not bother a good tennis player

    Synonyms: undercut

  15. 15

    the division of a deck of cards before dealing

    cut%1:04:09:: · cut.n.15

    • he insisted that we give him the last cut before every deal
    • the cutting of the cards soon became a ritual

    Synonyms: cutting

  16. 16

    the act of penetrating or opening open with a sharp edge

    cut%1:04:02:: · cut.n.16

    • his cut in the lining revealed the hidden jewels

    Synonyms: cutting

  17. 17

    the act of cutting something into parts

    cut%1:04:01:: · cut.n.17

    • his cuts were skillful
    • his cutting of the cake made a terrible mess

    Synonyms: cutting

  18. 18

    the act of shortening something by chopping off the ends

    cut%1:04:00:: · cut.n.18

    • the barber gave him a good cut

    Synonyms: cutting, cutting off

  19. 19

    the act of reducing the amount or number

    cut%1:04:05:: · cut.n.19

    • the mayor proposed extensive cuts in the city budget
    Gold lexEN Gold Maru 2022 Gold Raganato
  20. 20

    an unexcused absence from class

    cut%1:04:06:: · cut.n.20

    • he was punished for taking too many cuts in his math class

cut Noun

Instance: semeval2013.d000.s014.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The United States is not going to do a deal without the major developing countries stepping up and taking action, said Stern, who also complained that the text did not do enough to make sure the cuts could be verified by outside observers.

Show raw prompt

user

Which numbered sense of "cut" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The United States is not going to do a deal without the major developing countries stepping up and taking action, said Stern, who also complained that the text did not do enough to make sure the <t>cuts</t> could be verified by outside observers.

Senses:
1. definition=a share of the profits | examples=everyone got a cut of the earnings
2. definition=(film) an immediate transition from one shot to the next | examples=the cut from the accident scene to the hospital seemed too abrupt
3. definition=a trench resembling a furrow that was made by erosion or excavation
4. definition=a step on some scale | examples=he is a cut above the rest
5. definition=a wound made by cutting | examples=he put a bandage over the cut
6. definition=a piece of meat that has been cut from an animal carcass
7. definition=a remark capable of wounding mentally | examples=the unkindest cut of all
8. definition=a distinct selection of music from a recording or a compact disc | examples=he played the first cut on the cd
9. definition=the omission that is made when an editorial change shortens a written passage | examples=an editor's deletions frequently upset young authors
10. definition=the style in which a garment is cut | examples=a dress of traditional cut
11. definition=a canal made by erosion or excavation
12. definition=a refusal to recognize someone you know | examples=the snub was clearly intentional
13. definition=in baseball; a batter's attempt to hit a pitched ball | examples=he took a vicious cut at the ball
14. definition=(sports) a stroke that puts reverse spin on the ball | examples=cuts do not bother a good tennis player
15. definition=the division of a deck of cards before dealing | examples=he insisted that we give him the last cut before every deal
16. definition=the act of penetrating or opening open with a sharp edge | examples=his cut in the lining revealed the hidden jewels
17. definition=the act of cutting something into parts | examples=his cuts were skillful
18. definition=the act of shortening something by chopping off the ends | examples=the barber gave him a good cut
19. definition=the act of reducing the amount or number | examples=the mayor proposed extensive cuts in the city budget
20. definition=an unexcused absence from class | examples=he was punished for taking too many cuts in his math class

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a share of the profits

    cut%1:21:00:: · cut.n.01

    • everyone got a cut of the earnings
    Selected
  2. 2

    (film) an immediate transition from one shot to the next

    cut%1:10:00:: · cut.n.02

    • the cut from the accident scene to the hospital seemed too abrupt
  3. 3

    a trench resembling a furrow that was made by erosion or excavation

    cut%1:06:00:: · cut.n.03

    Synonyms: gash

  4. 4

    a step on some scale

    cut%1:26:01:: · cut.n.04

    • he is a cut above the rest
  5. 5

    a wound made by cutting

    cut%1:26:00:: · cut.n.05

    • he put a bandage over the cut

    Synonyms: gash, slash, slice

  6. 6

    a piece of meat that has been cut from an animal carcass

    cut%1:13:00:: · cut.n.06

    Synonyms: cut of meat

  7. 7

    a remark capable of wounding mentally

    cut%1:10:02:: · stinger.n.02

    • the unkindest cut of all

    Synonyms: stinger

  8. 8

    a distinct selection of music from a recording or a compact disc

    cut%1:10:04:: · cut.n.08

    • he played the first cut on the cd
    • the title track of the album

    Synonyms: track

  9. 9

    the omission that is made when an editorial change shortens a written passage

    cut%1:10:01:: · deletion.n.03

    • an editor's deletions frequently upset young authors
    • both parties agreed on the excision of the proposed clause

    Synonyms: deletion, excision

  10. 10

    the style in which a garment is cut

    cut%1:09:00:: · cut.n.10

    • a dress of traditional cut
  11. 11

    a canal made by erosion or excavation

    cut%1:06:01:: · cut.n.11

  12. 12

    a refusal to recognize someone you know

    cut%1:04:03:: · snub.n.02

    • the snub was clearly intentional

    Synonyms: snub, cold shoulder

  13. 13

    in baseball; a batter's attempt to hit a pitched ball

    cut%1:04:07:: · baseball_swing.n.01

    • he took a vicious cut at the ball

    Synonyms: baseball swing, swing

  14. 14

    (sports) a stroke that puts reverse spin on the ball

    cut%1:04:08:: · cut.n.14

    • cuts do not bother a good tennis player

    Synonyms: undercut

  15. 15

    the division of a deck of cards before dealing

    cut%1:04:09:: · cut.n.15

    • he insisted that we give him the last cut before every deal
    • the cutting of the cards soon became a ritual

    Synonyms: cutting

  16. 16

    the act of penetrating or opening open with a sharp edge

    cut%1:04:02:: · cut.n.16

    • his cut in the lining revealed the hidden jewels

    Synonyms: cutting

  17. 17

    the act of cutting something into parts

    cut%1:04:01:: · cut.n.17

    • his cuts were skillful
    • his cutting of the cake made a terrible mess

    Synonyms: cutting

  18. 18

    the act of shortening something by chopping off the ends

    cut%1:04:00:: · cut.n.18

    • the barber gave him a good cut

    Synonyms: cutting, cutting off

  19. 19

    the act of reducing the amount or number

    cut%1:04:05:: · cut.n.19

    • the mayor proposed extensive cuts in the city budget
    Gold lexEN Gold Maru 2022 Gold Raganato
  20. 20

    an unexcused absence from class

    cut%1:04:06:: · cut.n.20

    • he was punished for taking too many cuts in his math class

draft Noun

Instance: semeval2013.d000.s021.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The Alliance of Small Island States, which has 43 members, produced a 24-page draft treaty proposal early Friday morning.

Show raw prompt

user

Which numbered sense of "draft" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The Alliance of Small Island States, which has 43 members, produced a 24-page <t>draft</t> treaty proposal early Friday morning.

Senses:
1. definition=a document ordering the payment of money; drawn by one person or bank on another
2. definition=a current of air (usually coming into a chimney or room or vehicle)
3. definition=a preliminary sketch of a design or picture
4. definition=a serving of drink (usually alcoholic) drawn from a keg | examples=they served beer on draft
5. definition=any of the various versions in the development of a written work | examples=a preliminary draft
6. definition=the depth of a vessel's keel below the surface (especially when loaded)
7. definition=a regulator for controlling the flow of air in a fireplace
8. definition=a dose of liquid medicine | examples=he took a sleeping draft
9. definition=compulsory military service
10. definition=a large and hurried swallow | examples=he finished it at a single gulp
11. definition=the act of moving a load by drawing or pulling

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a document ordering the payment of money; drawn by one person or bank on another

    draft%1:21:00:: · draft.n.01

    Synonyms: bill of exchange, order of payment

  2. 2

    a current of air (usually coming into a chimney or room or vehicle)

    draft%1:19:00:: · draft.n.02

    Synonyms: draught

  3. 3

    a preliminary sketch of a design or picture

    draft%1:06:01:: · draft.n.03

    Synonyms: rough drawing

    Selected
  4. 4

    a serving of drink (usually alcoholic) drawn from a keg

    draft%1:13:00:: · draft.n.04

    • they served beer on draft

    Synonyms: draught, potation, tipple

  5. 5

    any of the various versions in the development of a written work

    draft%1:10:00:: · draft.n.05

    • a preliminary draft
    • the final draft of the constitution

    Synonyms: draft copy

    Gold lexEN Gold Maru 2022 Gold Raganato
  6. 6

    the depth of a vessel's keel below the surface (especially when loaded)

    draft%1:07:00:: · draft.n.06

    Synonyms: draught

  7. 7

    a regulator for controlling the flow of air in a fireplace

    draft%1:06:02:: · draft.n.07

  8. 8

    a dose of liquid medicine

    draft%1:06:00:: · draft.n.08

    • he took a sleeping draft

    Synonyms: draught

  9. 9

    compulsory military service

    draft%1:04:03:: · conscription.n.01

    Synonyms: conscription, muster, selective service

  10. 10

    a large and hurried swallow

    draft%1:04:02:: · gulp.n.01

    • he finished it at a single gulp

    Synonyms: gulp, draught, swig

  11. 11

    the act of moving a load by drawing or pulling

    draft%1:04:00:: · draft.n.11

    Synonyms: draught, drawing

draft Noun

Instance: semeval2013.d000.s025.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and draft proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge.

Show raw prompt

user

Which numbered sense of "draft" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The sheer sprawl of the gathering -- where 13,000 people move in and out of the convention center each day, guitar-playing activists put on nightly shows mocking the countries they think are selling out, and <t>draft</t> proposals are passed hand-to-hand on paper rather than via e-mail -- poses a challenge.

Senses:
1. definition=a document ordering the payment of money; drawn by one person or bank on another
2. definition=a current of air (usually coming into a chimney or room or vehicle)
3. definition=a preliminary sketch of a design or picture
4. definition=a serving of drink (usually alcoholic) drawn from a keg | examples=they served beer on draft
5. definition=any of the various versions in the development of a written work | examples=a preliminary draft
6. definition=the depth of a vessel's keel below the surface (especially when loaded)
7. definition=a regulator for controlling the flow of air in a fireplace
8. definition=a dose of liquid medicine | examples=he took a sleeping draft
9. definition=compulsory military service
10. definition=a large and hurried swallow | examples=he finished it at a single gulp
11. definition=the act of moving a load by drawing or pulling

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a document ordering the payment of money; drawn by one person or bank on another

    draft%1:21:00:: · draft.n.01

    Synonyms: bill of exchange, order of payment

  2. 2

    a current of air (usually coming into a chimney or room or vehicle)

    draft%1:19:00:: · draft.n.02

    Synonyms: draught

  3. 3

    a preliminary sketch of a design or picture

    draft%1:06:01:: · draft.n.03

    Synonyms: rough drawing

    Selected
  4. 4

    a serving of drink (usually alcoholic) drawn from a keg

    draft%1:13:00:: · draft.n.04

    • they served beer on draft

    Synonyms: draught, potation, tipple

  5. 5

    any of the various versions in the development of a written work

    draft%1:10:00:: · draft.n.05

    • a preliminary draft
    • the final draft of the constitution

    Synonyms: draft copy

    Gold lexEN Gold Maru 2022 Gold Raganato
  6. 6

    the depth of a vessel's keel below the surface (especially when loaded)

    draft%1:07:00:: · draft.n.06

    Synonyms: draught

  7. 7

    a regulator for controlling the flow of air in a fireplace

    draft%1:06:02:: · draft.n.07

  8. 8

    a dose of liquid medicine

    draft%1:06:00:: · draft.n.08

    • he took a sleeping draft

    Synonyms: draught

  9. 9

    compulsory military service

    draft%1:04:03:: · conscription.n.01

    Synonyms: conscription, muster, selective service

  10. 10

    a large and hurried swallow

    draft%1:04:02:: · gulp.n.01

    • he finished it at a single gulp

    Synonyms: gulp, draught, swig

  11. 11

    the act of moving a load by drawing or pulling

    draft%1:04:00:: · draft.n.11

    Synonyms: draught, drawing

quarter Noun

Instance: semeval2013.d001.s007.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Show raw prompt

user

Which numbered sense of "quarter" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The second <t>quarter</t> was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Senses:
1. definition=one of four equal parts | examples=a quarter of a pound
2. definition=a district of a city having some distinguishing character | examples=the Latin Quarter
3. definition=(football, professional basketball) one of four divisions into which some games are divided | examples=both teams scored in the first quarter
4. definition=a unit of time equal to 15 minutes or a quarter of an hour | examples=it's a quarter til 4
5. definition=one of four periods into which the school year is divided | examples=the fall quarter ends at Christmas
6. definition=a fourth part of a year; three months | examples=unemployment fell during the last quarter
7. definition=one of the four major division of the compass | examples=the wind is coming from that quarter
8. definition=a quarter of a hundredweight (25 pounds)
9. definition=a quarter of a hundredweight (28 pounds)
10. definition=a United States or Canadian coin worth one fourth of a dollar | examples=he fed four quarters into the slot machine
11. definition=an unspecified person | examples=he dropped a word in the right quarter
12. definition=the rear part of a ship
13. definition=piece of leather that comprises the part of a shoe or boot covering the heel and joining the vamp
14. definition=clemency or mercy shown to a defeated opponent | examples=he surrendered but asked for quarter

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    one of four equal parts

    quarter%1:23:01:: · one-fourth.n.01

    • a quarter of a pound

    Synonyms: one-fourth, fourth, one-quarter, fourth part, twenty-five percent, quartern

  2. 2

    a district of a city having some distinguishing character

    quarter%1:15:00:: · quarter.n.02

    • the Latin Quarter
  3. 3

    (football, professional basketball) one of four divisions into which some games are divided

    quarter%1:28:01:: · quarter.n.03

    • both teams scored in the first quarter
    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    a unit of time equal to 15 minutes or a quarter of an hour

    quarter%1:28:03:: · quarter.n.04

    • it's a quarter til 4
    • a quarter after 4 o'clock
    Selected
  5. 5

    one of four periods into which the school year is divided

    quarter%1:28:00:: · quarter.n.05

    • the fall quarter ends at Christmas
  6. 6

    a fourth part of a year; three months

    quarter%1:28:02:: · quarter.n.06

    • unemployment fell during the last quarter
  7. 7

    one of the four major division of the compass

    quarter%1:24:00:: · quarter.n.07

    • the wind is coming from that quarter
  8. 8

    a quarter of a hundredweight (25 pounds)

    quarter%1:23:02:: · quarter.n.08

  9. 9

    a quarter of a hundredweight (28 pounds)

    quarter%1:23:04:: · quarter.n.09

  10. 10

    a United States or Canadian coin worth one fourth of a dollar

    quarter%1:21:00:: · quarter.n.10

    • he fed four quarters into the slot machine
  11. 11

    an unspecified person

    quarter%1:18:00:: · quarter.n.11

    • he dropped a word in the right quarter
  12. 12

    the rear part of a ship

    quarter%1:06:00:: · stern.n.01

    Synonyms: stern, after part, poop, tail

  13. 13

    piece of leather that comprises the part of a shoe or boot covering the heel and joining the vamp

    quarter%1:06:01:: · quarter.n.13

  14. 14

    clemency or mercy shown to a defeated opponent

    quarter%1:04:00:: · quarter.n.14

    • he surrendered but asked for quarter

lead Noun

Instance: semeval2013.d001.s007.t008 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their lead by half-time (34-43).

Show raw prompt

user

Which numbered sense of "lead" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The second quarter was more of the same, but the Alavan team opted for the inside game of Barac and the work of Eliyahu, who was greeted with whistles and applause at his return home, to continue increasing their <t>lead</t> by half-time (34-43).

Senses:
1. definition=an advantage held by a competitor in a race | examples=he took the lead at the last turn
2. definition=a soft heavy toxic malleable metallic element; bluish white when freshly cut but tarnishes readily to dull grey | examples=the children were playing with lead soldiers
3. definition=evidence pointing to a possible solution | examples=the police are following a promising lead
4. definition=a position of leadership (especially in the phrase `take the lead') | examples=he takes the lead in any group
5. definition=the angle between the direction a gun is aimed and the position of a moving target (correcting for the flight time of the missile)
6. definition=the introductory section of a story | examples=it was an amusing lead-in to a very serious matter
7. definition=(sports) the score by which a team or individual is winning
8. definition=an actor who plays a principal role
9. definition=(baseball) the position taken by a base runner preparing to advance to the next base | examples=he took a long lead off first
10. definition=an indication of potential opportunity | examples=he got a tip on the stock market
11. definition=a news story of major importance
12. definition=the timing of ignition relative to the position of the piston in an internal-combustion engine
13. definition=restraint consisting of a rope (or light chain) used to restrain an animal
14. definition=thin strip of metal used to separate lines of type in printing
15. definition=mixture of graphite with clay in different degrees of hardness; the marking substance in a pencil
16. definition=a jumper that consists of a short piece of wire | examples=it was a tangle of jumper cables and clip leads
17. definition=the playing of a card to start a trick in bridge | examples=the lead was in the dummy

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    an advantage held by a competitor in a race

    lead%1:07:02:: · lead.n.01

    • he took the lead at the last turn
    Gold Raganato Selected
  2. 2

    a soft heavy toxic malleable metallic element; bluish white when freshly cut but tarnishes readily to dull grey

    lead%1:27:00:: · lead.n.02

    • the children were playing with lead soldiers

    Synonyms: Pb, atomic number 82

  3. 3

    evidence pointing to a possible solution

    lead%1:09:00:: · lead.n.03

    • the police are following a promising lead
    • the trail led straight to the perpetrator

    Synonyms: track, trail

  4. 4

    a position of leadership (especially in the phrase `take the lead')

    lead%1:04:01:: · lead.n.04

    • he takes the lead in any group
    • we were just waiting for someone to take the lead
  5. 5

    the angle between the direction a gun is aimed and the position of a moving target (correcting for the flight time of the missile)

    lead%1:25:00:: · lead.n.05

  6. 6

    the introductory section of a story

    lead%1:10:01:: · lead.n.06

    • it was an amusing lead-in to a very serious matter

    Synonyms: lead-in, lede

  7. 7

    (sports) the score by which a team or individual is winning

    lead%1:23:00:: · lead.n.07

    Gold lexEN Gold Maru 2022
  8. 8

    an actor who plays a principal role

    lead%1:18:00:: · star.n.04

    Synonyms: star, principal

  9. 9

    (baseball) the position taken by a base runner preparing to advance to the next base

    lead%1:15:00:: · lead.n.09

    • he took a long lead off first
  10. 10

    an indication of potential opportunity

    lead%1:10:02:: · tip.n.03

    • he got a tip on the stock market
    • a good lead for a job

    Synonyms: tip, steer, confidential information, wind, hint

  11. 11

    a news story of major importance

    lead%1:10:00:: · lead.n.11

    Synonyms: lead story

  12. 12

    the timing of ignition relative to the position of the piston in an internal-combustion engine

    lead%1:07:01:: · spark_advance.n.01

    Synonyms: spark advance

  13. 13

    restraint consisting of a rope (or light chain) used to restrain an animal

    lead%1:06:03:: · leash.n.01

    Synonyms: leash, tether

  14. 14

    thin strip of metal used to separate lines of type in printing

    lead%1:06:02:: · lead.n.14

    Synonyms: leading

  15. 15

    mixture of graphite with clay in different degrees of hardness; the marking substance in a pencil

    lead%1:06:00:: · lead.n.15

    Synonyms: pencil lead

  16. 16

    a jumper that consists of a short piece of wire

    lead%1:06:01:: · jumper_cable.n.01

    • it was a tangle of jumper cables and clip leads

    Synonyms: jumper cable, jumper lead, booster cable

  17. 17

    the playing of a card to start a trick in bridge

    lead%1:04:00:: · lead.n.17

    • the lead was in the dummy

game Noun

Instance: semeval2013.d001.s009.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the game.

Show raw prompt

user

Which numbered sense of "game" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: But the game, despite being headed for halftime, was not more decidedand the Maccabees tried to remind the Vitorians that not just anybody wins on their court, and with the 'hand of Elias' putting the pressure on, they managed to get involved in the <t>game</t>.

Senses:
1. definition=a contest with rules to determine a winner | examples=you need four people to play this game
2. definition=a single play of a sport or other contest | examples=the game lasted two hours
3. definition=an amusement or pastime | examples=they played word games
4. definition=animal hunted for food or sport
5. definition=(tennis) a division of play during which one player serves
6. definition=(games) the score at a particular point or the score needed to win | examples=the game is 6 all
7. definition=the flesh of wild animals that is used for food
8. definition=a secret scheme to do something (especially something underhand or illegal) | examples=they concocted a plot to discredit the governor
9. definition=the game equipment needed in order to play a particular game | examples=the child received several games for his birthday
10. definition=your occupation or line of work | examples=he's in the plumbing game
11. definition=frivolous or trifling behavior | examples=for actors, memorizing lines is no game

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a contest with rules to determine a winner

    game%1:04:00:: · game.n.01

    • you need four people to play this game
    Selected
  2. 2

    a single play of a sport or other contest

    game%1:04:03:: · game.n.02

    • the game lasted two hours
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    an amusement or pastime

    game%1:04:01:: · game.n.03

    • they played word games
    • he thought of his painting as a game that filled his empty time
  4. 4

    animal hunted for food or sport

    game%1:05:00:: · game.n.04

  5. 5

    (tennis) a division of play during which one player serves

    game%1:28:00:: · game.n.05

  6. 6

    (games) the score at a particular point or the score needed to win

    game%1:23:00:: · game.n.06

    • the game is 6 all
    • he is serving for the game
  7. 7

    the flesh of wild animals that is used for food

    game%1:13:00:: · game.n.07

  8. 8

    a secret scheme to do something (especially something underhand or illegal)

    game%1:09:00:: · plot.n.01

    • they concocted a plot to discredit the governor
    • I saw through his little game from the start

    Synonyms: plot, secret plan

  9. 9

    the game equipment needed in order to play a particular game

    game%1:06:00:: · game.n.09

    • the child received several games for his birthday
  10. 10

    your occupation or line of work

    game%1:04:02:: · game.n.10

    • he's in the plumbing game
    • she's in show biz

    Synonyms: biz

  11. 11

    frivolous or trifling behavior

    game%1:04:04:: · game.n.11

    • for actors, memorizing lines is no game
    • for him, life is all fun and games

line Noun

Instance: semeval2013.d001.s014.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point line (70-77).

Show raw prompt

user

Which numbered sense of "line" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: However, Pnini and Eidson, the best on their team, did not give up and tried to keep their team alive from the three-point <t>line</t> (70-77).

Senses:
1. definition=a formation of people or things one beside another | examples=the line of soldiers advanced with their bayonets fixed
2. definition=a mark that is long relative to its width | examples=He drew a line on the chart
3. definition=a formation of people or things one behind another | examples=the line stretched clear around the corner
4. definition=a length (straight or curved) without breadth or thickness; the trace of a moving point
5. definition=text consisting of a row of words written across a page or computer screen | examples=the letter consisted of three short lines
6. definition=a single frequency (or very narrow band) of radiation in a spectrum
7. definition=a fortified position (especially one marking the most forward position of troops) | examples=they attacked the enemy's line
8. definition=a course of reasoning aimed at demonstrating a truth or falsehood; the methodical process of logical reasoning | examples=I can't follow your line of reasoning
9. definition=a conductor for transmitting electrical or optical signals or electric power
10. definition=a connected series of events or actions or developments | examples=the government took a firm course
11. definition=a spatial location defined by a real or imaginary unidimensional extent
12. definition=a slight depression in the smoothness of a surface | examples=his face has many lines
13. definition=a pipe used to transport liquids or gases | examples=a pipeline runs from the wells to the seaport
14. definition=the road consisting of railroad track and roadbed
15. definition=a telephone connection
16. definition=acting in conformity | examples=in line with
17. definition=the descendants of one individual | examples=his entire lineage has been warriors
18. definition=something (as a cord or rope) that is long and thin and flexible | examples=a washing line
19. definition=the principal activity in your life that you do to earn money | examples=he's not in my line of business
20. definition=in games or sports; a mark indicating positions or bounds of the playing area
21. definition=(often plural) a means of communication or access | examples=it must go through official channels
22. definition=a particular kind of product or merchandise | examples=a nice line of shoes
23. definition=a commercial organization serving as a common carrier
24. definition=space for one line of print (one column wide and 1/14 inch deep) used to measure advertising
25. definition=the maximum credit that a customer is allowed
26. definition=a succession of notes forming a distinctive sequence | examples=she was humming an air from Beethoven
27. definition=persuasive but insincere talk that is usually intended to deceive or impress | examples=`let me show you my etchings' is a rather worn line
28. definition=a short personal letter | examples=drop me a line when you get there
29. definition=a conceptual separation or distinction | examples=there is a narrow line between sanity and insanity
30. definition=mechanical system in a factory whereby an article is conveyed through sites at which successive operations are performed on it

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a formation of people or things one beside another

    line%1:14:03:: · line.n.01

    • the line of soldiers advanced with their bayonets fixed
    • they were arrayed in line of battle
  2. 2

    a mark that is long relative to its width

    line%1:10:01:: · line.n.02

    • He drew a line on the chart
  3. 3

    a formation of people or things one behind another

    line%1:14:01:: · line.n.03

    • the line stretched clear around the corner
    • you must wait in a long line at the checkout counter
  4. 4

    a length (straight or curved) without breadth or thickness; the trace of a moving point

    line%1:25:00:: · line.n.04

  5. 5

    text consisting of a row of words written across a page or computer screen

    line%1:10:02:: · line.n.05

    • the letter consisted of three short lines
    • there are six lines in every stanza
  6. 6

    a single frequency (or very narrow band) of radiation in a spectrum

    line%1:19:00:: · line.n.06

  7. 7

    a fortified position (especially one marking the most forward position of troops)

    line%1:15:02:: · line.n.07

    • they attacked the enemy's line
  8. 8

    a course of reasoning aimed at demonstrating a truth or falsehood; the methodical process of logical reasoning

    line%1:09:01:: · argumentation.n.02

    • I can't follow your line of reasoning

    Synonyms: argumentation, logical argument, argument, line of reasoning

  9. 9

    a conductor for transmitting electrical or optical signals or electric power

    line%1:06:01:: · cable.n.02

    Synonyms: cable, transmission line

  10. 10

    a connected series of events or actions or developments

    line%1:14:02:: · course.n.02

    • the government took a firm course
    • historians can only point out those lines for which evidence is available

    Synonyms: course

  11. 11

    a spatial location defined by a real or imaginary unidimensional extent

    line%1:15:00:: · line.n.11

    Selected
  12. 12

    a slight depression in the smoothness of a surface

    line%1:25:01:: · wrinkle.n.01

    • his face has many lines
    • ironing gets rid of most wrinkles

    Synonyms: wrinkle, furrow, crease, crinkle, seam

  13. 13

    a pipe used to transport liquids or gases

    line%1:06:06:: · pipeline.n.02

    • a pipeline runs from the wells to the seaport

    Synonyms: pipeline

  14. 14

    the road consisting of railroad track and roadbed

    line%1:06:03:: · line.n.14

    Synonyms: railway line, rail line

  15. 15

    a telephone connection

    line%1:06:07:: · telephone_line.n.02

    Synonyms: telephone line, phone line, telephone circuit, subscriber line

  16. 16

    acting in conformity

    line%1:04:01:: · line.n.16

    • in line with
    • he got out of line
  17. 17

    the descendants of one individual

    line%1:14:00:: · lineage.n.01

    • his entire lineage has been warriors

    Synonyms: lineage, line of descent, descent, bloodline, blood, pedigree, ancestry, origin, parentage, stemma, stock

  18. 18

    something (as a cord or rope) that is long and thin and flexible

    line%1:06:00:: · line.n.18

    • a washing line
  19. 19

    the principal activity in your life that you do to earn money

    line%1:04:00:: · occupation.n.01

    • he's not in my line of business

    Synonyms: occupation, business, job, line of work

  20. 20

    in games or sports; a mark indicating positions or bounds of the playing area

    line%1:15:01:: · line.n.20

    Gold lexEN Gold Maru 2022 Gold Raganato
  21. 21

    (often plural) a means of communication or access

    line%1:10:05:: · channel.n.05

    • it must go through official channels
    • lines of communication were set up between the two firms

    Synonyms: channel, communication channel

  22. 22

    a particular kind of product or merchandise

    line%1:06:08:: · line.n.22

    • a nice line of shoes

    Synonyms: product line, line of products, line of merchandise, business line, line of business

  23. 23

    a commercial organization serving as a common carrier

    line%1:06:05:: · line.n.23

  24. 24

    space for one line of print (one column wide and 1/14 inch deep) used to measure advertising

    line%1:23:00:: · agate_line.n.01

    Synonyms: agate line

  25. 25

    the maximum credit that a customer is allowed

    line%1:21:00:: · credit_line.n.01

    Synonyms: credit line, line of credit, bank line, personal credit line, personal line of credit

  26. 26

    a succession of notes forming a distinctive sequence

    line%1:10:03:: · tune.n.01

    • she was humming an air from Beethoven

    Synonyms: tune, melody, air, strain, melodic line, melodic phrase

  27. 27

    persuasive but insincere talk that is usually intended to deceive or impress

    line%1:10:06:: · line.n.27

    • `let me show you my etchings' is a rather worn line
    • he has a smooth line but I didn't fall for it
  28. 28

    a short personal letter

    line%1:10:04:: · note.n.02

    • drop me a line when you get there

    Synonyms: note, short letter, billet

  29. 29

    a conceptual separation or distinction

    line%1:09:00:: · line.n.29

    • there is a narrow line between sanity and insanity

    Synonyms: dividing line, demarcation, contrast

  30. 30

    mechanical system in a factory whereby an article is conveyed through sites at which successive operations are performed on it

    line%1:06:09:: · production_line.n.01

    Synonyms: production line, assembly line

figure Noun

Instance: semeval2013.d002.s002.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

Show raw prompt

user

Which numbered sense of "figure" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: According to final closing <t>figures</t>, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

Senses:
1. definition=a diagram or picture illustrating textual material | examples=the area covered can be seen from Figure 2
2. definition=alternative names for the body of a human being | examples=Leonardo studied the human body
3. definition=one of the elements that collectively form a system of numeration | examples=0 and 1 are digits
4. definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
5. definition=a well-known or notable person | examples=they studied all the great names in the history of France
6. definition=a combination of points and lines and planes that form a visible palpable shape
7. definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
8. definition=the impression produced by a person | examples=he cut a fine figure
9. definition=the property possessed by a sum or total or indefinite quantity of units or individuals | examples=he had a number of chores to do
10. definition=language used in a figurative or nonliteral sense
11. definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground
12. definition=a decorative or artistic work | examples=the coach had a design on the doors
13. definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  2. 2

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  3. 3

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  4. 4

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  5. 5

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  6. 6

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

  7. 7

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
    Selected
  8. 8

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  9. 9

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  11. 11

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

  12. 12

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  13. 13

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures

field Noun

Instance: semeval2013.d003.s003.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

American companies walked away with stakes in just two of the 10 auctioned fields.

Show raw prompt

user

Which numbered sense of "field" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: American companies walked away with stakes in just two of the 10 auctioned <t>fields</t>.

Senses:
1. definition=a piece of land cleared of trees and usually enclosed | examples=he planted a field of wheat
2. definition=a region where a battle is being (or has been) fought | examples=they made a tour of Civil War battlefields
3. definition=somewhere (away from a studio or office or library or laboratory) where practical work is done or data is collected | examples=anthropologists do much of their work in the field
4. definition=a branch of knowledge | examples=in what discipline is his doctorate?
5. definition=the space around a radiating body within which its electromagnetic oscillations can exert force on another similar body not in contact with it
6. definition=a particular kind of commercial enterprise | examples=they are outstanding in their field
7. definition=a particular environment or walk of life | examples=his social sphere is limited
8. definition=a piece of land prepared for playing a game | examples=the home crowd cheered when Princeton took the field
9. definition=extensive tract of level open land | examples=they emerged from the woods onto a vast open plain
10. definition=(mathematics) a set of elements such that addition and multiplication are commutative and associative and multiplication is distributive over addition and there are two elements 0 and 1 | examples=the set of all rational numbers is a field
11. definition=a region in which active military operations are in progress | examples=the army was in the field awaiting action
12. definition=all of the horses in a particular horse race
13. definition=all the competitors in a particular contest or sporting event
14. definition=a geographic region (land or sea) under which something valuable is found | examples=the diamond fields of South Africa
15. definition=(computer science) a set of one or more adjacent characters comprising a unit of information
16. definition=the area that is visible (as through an optical instrument)
17. definition=a place where planes take off and land

Prediction matches gold: lexEN ✗ Maru 2022 ✓ Raganato ✓

WordNet 3.0 senses

  1. 1

    a piece of land cleared of trees and usually enclosed

    field%1:15:00:: · field.n.01

    • he planted a field of wheat
    Gold Maru 2022 Gold Raganato Selected
  2. 2

    a region where a battle is being (or has been) fought

    field%1:15:04:: · battlefield.n.01

    • they made a tour of Civil War battlefields

    Synonyms: battlefield, battleground, field of battle, field of honor

  3. 3

    somewhere (away from a studio or office or library or laboratory) where practical work is done or data is collected

    field%1:15:01:: · field.n.03

    • anthropologists do much of their work in the field
  4. 4

    a branch of knowledge

    field%1:09:00:: · discipline.n.01

    • in what discipline is his doctorate?
    • teachers should be well trained in their subject

    Synonyms: discipline, subject, subject area, subject field, field of study, study, bailiwick

  5. 5

    the space around a radiating body within which its electromagnetic oscillations can exert force on another similar body not in contact with it

    field%1:19:00:: · field.n.05

    Synonyms: field of force, force field

  6. 6

    a particular kind of commercial enterprise

    field%1:04:00:: · field.n.06

    • they are outstanding in their field

    Synonyms: field of operation, line of business

  7. 7

    a particular environment or walk of life

    field%1:26:00:: · sphere.n.01

    • his social sphere is limited
    • it was a closed area of employment

    Synonyms: sphere, domain, area, orbit, arena

  8. 8

    a piece of land prepared for playing a game

    field%1:15:02:: · playing_field.n.02

    • the home crowd cheered when Princeton took the field

    Synonyms: playing field, athletic field, playing area

  9. 9

    extensive tract of level open land

    field%1:17:00:: · plain.n.01

    • they emerged from the woods onto a vast open plain
    • he longed for the fields of his youth

    Synonyms: plain, champaign

  10. 10

    (mathematics) a set of elements such that addition and multiplication are commutative and associative and multiplication is distributive over addition and there are two elements 0 and 1

    field%1:14:00:: · field.n.10

    • the set of all rational numbers is a field
  11. 11

    a region in which active military operations are in progress

    field%1:15:03:: · field.n.11

    • the army was in the field awaiting action
    • he served in the Vietnam theater for three years

    Synonyms: field of operations, theater, theater of operations, theatre, theatre of operations

  12. 12

    all of the horses in a particular horse race

    field%1:14:01:: · field.n.12

  13. 13

    all the competitors in a particular contest or sporting event

    field%1:14:02:: · field.n.13

  14. 14

    a geographic region (land or sea) under which something valuable is found

    field%1:15:05:: · field.n.14

    • the diamond fields of South Africa
    Gold lexEN
  15. 15

    (computer science) a set of one or more adjacent characters comprising a unit of information

    field%1:14:03:: · field.n.15

  16. 16

    the area that is visible (as through an optical instrument)

    field%1:09:01:: · field.n.16

    Synonyms: field of view

  17. 17

    a place where planes take off and land

    field%1:06:00:: · airfield.n.01

    Synonyms: airfield, landing field, flying field

field Noun

Instance: semeval2013.d003.s006.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Two American companies reached deals for fields auctioned in June.

Show raw prompt

user

Which numbered sense of "field" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Two American companies reached deals for <t>fields</t> auctioned in June.

Senses:
1. definition=a piece of land cleared of trees and usually enclosed | examples=he planted a field of wheat
2. definition=a region where a battle is being (or has been) fought | examples=they made a tour of Civil War battlefields
3. definition=somewhere (away from a studio or office or library or laboratory) where practical work is done or data is collected | examples=anthropologists do much of their work in the field
4. definition=a branch of knowledge | examples=in what discipline is his doctorate?
5. definition=the space around a radiating body within which its electromagnetic oscillations can exert force on another similar body not in contact with it
6. definition=a particular kind of commercial enterprise | examples=they are outstanding in their field
7. definition=a particular environment or walk of life | examples=his social sphere is limited
8. definition=a piece of land prepared for playing a game | examples=the home crowd cheered when Princeton took the field
9. definition=extensive tract of level open land | examples=they emerged from the woods onto a vast open plain
10. definition=(mathematics) a set of elements such that addition and multiplication are commutative and associative and multiplication is distributive over addition and there are two elements 0 and 1 | examples=the set of all rational numbers is a field
11. definition=a region in which active military operations are in progress | examples=the army was in the field awaiting action
12. definition=all of the horses in a particular horse race
13. definition=all the competitors in a particular contest or sporting event
14. definition=a geographic region (land or sea) under which something valuable is found | examples=the diamond fields of South Africa
15. definition=(computer science) a set of one or more adjacent characters comprising a unit of information
16. definition=the area that is visible (as through an optical instrument)
17. definition=a place where planes take off and land

Prediction matches gold: lexEN ✗ Maru 2022 ✓ Raganato ✓

WordNet 3.0 senses

  1. 1

    a piece of land cleared of trees and usually enclosed

    field%1:15:00:: · field.n.01

    • he planted a field of wheat
    Gold Maru 2022 Gold Raganato Selected
  2. 2

    a region where a battle is being (or has been) fought

    field%1:15:04:: · battlefield.n.01

    • they made a tour of Civil War battlefields

    Synonyms: battlefield, battleground, field of battle, field of honor

  3. 3

    somewhere (away from a studio or office or library or laboratory) where practical work is done or data is collected

    field%1:15:01:: · field.n.03

    • anthropologists do much of their work in the field
  4. 4

    a branch of knowledge

    field%1:09:00:: · discipline.n.01

    • in what discipline is his doctorate?
    • teachers should be well trained in their subject

    Synonyms: discipline, subject, subject area, subject field, field of study, study, bailiwick

  5. 5

    the space around a radiating body within which its electromagnetic oscillations can exert force on another similar body not in contact with it

    field%1:19:00:: · field.n.05

    Synonyms: field of force, force field

  6. 6

    a particular kind of commercial enterprise

    field%1:04:00:: · field.n.06

    • they are outstanding in their field

    Synonyms: field of operation, line of business

  7. 7

    a particular environment or walk of life

    field%1:26:00:: · sphere.n.01

    • his social sphere is limited
    • it was a closed area of employment

    Synonyms: sphere, domain, area, orbit, arena

  8. 8

    a piece of land prepared for playing a game

    field%1:15:02:: · playing_field.n.02

    • the home crowd cheered when Princeton took the field

    Synonyms: playing field, athletic field, playing area

  9. 9

    extensive tract of level open land

    field%1:17:00:: · plain.n.01

    • they emerged from the woods onto a vast open plain
    • he longed for the fields of his youth

    Synonyms: plain, champaign

  10. 10

    (mathematics) a set of elements such that addition and multiplication are commutative and associative and multiplication is distributive over addition and there are two elements 0 and 1

    field%1:14:00:: · field.n.10

    • the set of all rational numbers is a field
  11. 11

    a region in which active military operations are in progress

    field%1:15:03:: · field.n.11

    • the army was in the field awaiting action
    • he served in the Vietnam theater for three years

    Synonyms: field of operations, theater, theater of operations, theatre, theatre of operations

  12. 12

    all of the horses in a particular horse race

    field%1:14:01:: · field.n.12

  13. 13

    all the competitors in a particular contest or sporting event

    field%1:14:02:: · field.n.13

  14. 14

    a geographic region (land or sea) under which something valuable is found

    field%1:15:05:: · field.n.14

    • the diamond fields of South Africa
    Gold lexEN
  15. 15

    (computer science) a set of one or more adjacent characters comprising a unit of information

    field%1:14:03:: · field.n.15

  16. 16

    the area that is visible (as through an optical instrument)

    field%1:09:01:: · field.n.16

    Synonyms: field of view

  17. 17

    a place where planes take off and land

    field%1:06:00:: · airfield.n.01

    Synonyms: airfield, landing field, flying field

case Noun

Instance: semeval2013.d003.s011.t002 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

U.S. firms were in some cases at a disadvantage because rivals, particularly the Chinese and other government controlled energy firms, have markedly lower labor costs and are more prone to take risks because they don't respond to shareholders.

Show raw prompt

user

Which numbered sense of "case" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: U.S. firms were in some <t>cases</t> at a disadvantage because rivals, particularly the Chinese and other government controlled energy firms, have markedly lower labor costs and are more prone to take risks because they don't respond to shareholders.

Senses:
1. definition=an occurrence of something | examples=it was a case of bad judgment
2. definition=a special set of circumstances | examples=in that event, the first possibility is excluded
3. definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | examples=the family brought suit against the landlord
4. definition=the actual state of things | examples=that was not the case
5. definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | examples=the subjects for this investigation were selected randomly
8. definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. definition=the quantity contained in a case
11. definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence
12. definition=a specific state of mind that is temporary | examples=a case of the jitters
13. definition=a person of a specified kind (usually with many eccentricities) | examples=a real character
14. definition=a specific size and style of type within a type family
15. definition=an enveloping structure or covering enclosing an animal or plant organ or part
16. definition=the housing or outer covering of something | examples=the clock has a walnut case
17. definition=the enclosing frame around a door or window opening | examples=the casings had rotted away and had to be replaced
18. definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. definition=bed linen consisting of a cover for a pillow | examples=the burglar carried his loot in a pillowcase
20. definition=a glass container used to store and display items in a shop or museum or home

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

    Selected
  3. 3

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

  4. 4

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
  5. 5

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  6. 6

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  7. 7

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  8. 8

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
  9. 9

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  10. 10

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  11. 11

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  12. 12

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
  13. 13

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  14. 14

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

  15. 15

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  16. 16

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  17. 17

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  18. 18

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  19. 19

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  20. 20

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine