Verified run

openrouter/qwen/qwen3.7-plus

qwen3.7-plus-p002-lexen-v1-20260614

Rank
48
Accuracy lexEN v1 · WordNet fine
91.46%
Correct
4446 / 4861
Actual run cost
$3.20
Cost / M items
$659

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 91.46% 4446 / 4861 96.61% 4696 / 4861 94.24% 4581 / 4861
Maru 2022 (ALLamended) 88.95% 4324 / 4861 95.68% 4651 / 4861 92.82% 4512 / 4861
Raganato 2017 (original) 82.95% 4032 / 4861 93.05% 4523 / 4861 88.85% 4319 / 4861

Model

Display
openrouter/qwen/qwen3.7-plus
Requested
openrouter/qwen/qwen3.7-plus
Resolved
qwen/qwen3.7-plus-20260602
Vendor
Alibaba
API provider
OpenRouter
Hosting
cloud_api
Source
open_source
License
n/a
Reasoning
n/a
Model URL
n/a
Endpoint
n/a
Resolved counts
qwen/qwen3.7-plus-20260602: 4861

Reproducibility

Created
2026-06-14T17:43:42.620560+00:00
Run schema
sensebench-run-v2
Commit
0fd8fd16f996b2eb7461709514ed4d7f667d33f0
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p002
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
5,558,638
Tokens / item
1,143.5
Total cost
$3.20
Cost / M items
$659
Cost source
provider_reported
Elapsed
16.33m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
8,192
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $3.20. Cost estimate source: provider_reported.

Token Type Tokens Cost Price / 1M tokens
Input uncached 1,166,732 $0.373 n/a
Input cached 0 n/a n/a
Output 2,210,416 $2.83 n/a
Reasoning output 2,181,490 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 88.29% 701 794
Candidate Count 2 95.91% 820 855
Candidate Count 3-5 92.13% 1792 1945
Candidate Count 6-10 89.42% 1133 1267
POS ADJ 93.93% 619 659
POS ADV 91.28% 178 195
POS NOUN 91.75% 2658 2897
POS VERB 89.28% 991 1110
Source Dataset semeval2013 92.81% 1058 1140
Source Dataset semeval2015 90.66% 670 739
Source Dataset senseval2 91.47% 1490 1629
Source Dataset senseval3 90.76% 1228 1353

Worst-Bucket Examples

figure Noun

Instance: semeval2013.d002.s002.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

According to final closing figures, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

Show raw prompt

user

Which numbered sense of "figure" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: According to final closing <t>figures</t>, the Dow Jones Industrial Average has risen by 65.67 points to 10 471.50 points, whereas the NASDAQ, with a technology predominance, fell by 0.55 point to 2 190.31 points.

Senses:
1. definition=a diagram or picture illustrating textual material | examples=the area covered can be seen from Figure 2
2. definition=alternative names for the body of a human being | examples=Leonardo studied the human body
3. definition=one of the elements that collectively form a system of numeration | examples=0 and 1 are digits
4. definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
5. definition=a well-known or notable person | examples=they studied all the great names in the history of France
6. definition=a combination of points and lines and planes that form a visible palpable shape
7. definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
8. definition=the impression produced by a person | examples=he cut a fine figure
9. definition=the property possessed by a sum or total or indefinite quantity of units or individuals | examples=he had a number of chores to do
10. definition=language used in a figurative or nonliteral sense
11. definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground
12. definition=a decorative or artistic work | examples=the coach had a design on the doors
13. definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  2. 2

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  3. 3

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  4. 4

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  5. 5

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  6. 6

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

  7. 7

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
    Selected
  8. 8

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  9. 9

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  11. 11

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

  12. 12

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  13. 13

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures

court Noun

Instance: semeval2013.d005.s005.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the <t>courts</t> for years.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business
2. definition=a room in which a lawcourt sits | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947)
6. definition=the family and retinue of a sovereign or prince
7. definition=a hotel for motorists; provides direct access from rooms to parking area
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | examples=the house was built around an inner court
11. definition=respectful deference | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

court Noun

Instance: semeval2013.d005.s028.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the <t>courts</t>.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business
2. definition=a room in which a lawcourt sits | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947)
6. definition=the family and retinue of a sovereign or prince
7. definition=a hotel for motorists; provides direct access from rooms to parking area
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | examples=the house was built around an inner court
11. definition=respectful deference | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

part Noun

Instance: semeval2013.d006.s008.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Show raw prompt

user

Which numbered sense of "part" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: <t>Part</t> of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Senses:
1. definition=something determined in relation to something that includes it | examples=he wanted to feel a part of something bigger than himself
2. definition=something less than the whole of a human artifact | examples=the rear part of the house
3. definition=a portion of a natural object | examples=they analyzed the river into three parts
4. definition=that which concerns a person with regard to a particular role or situation | examples=it requires vigilance on our part
5. definition=the extended spatial location of something | examples=the farming regions of France
6. definition=the actions and activities assigned to or required or expected of a person or group | examples=the function of a teacher
7. definition=an actor's portrayal of someone in a play | examples=she played the part of Desdemona
8. definition=assets belonging to or due to or contributed by an individual person or group | examples=he wanted his share in cash
9. definition=one of the portions into which something is regarded as divided and which together constitute a whole | examples=the written part of the exam
10. definition=a line of scalp that can be seen when sections of hair are combed in opposite directions | examples=his part was right in the middle
11. definition=the melody carried by a particular voice or instrument in polyphonic music | examples=he tried to sing the tenor part
12. definition=the part played by a person in bringing about a result | examples=I am proud of my contribution in advancing the project

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    something determined in relation to something that includes it

    part%1:24:00:: · part.n.01

    • he wanted to feel a part of something bigger than himself
    • I read a portion of the manuscript

    Synonyms: portion, component part, component, constituent

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    something less than the whole of a human artifact

    part%1:06:00:: · part.n.02

    • the rear part of the house
    • glue the two parts together

    Synonyms: portion

  3. 3

    a portion of a natural object

    part%1:17:00:: · part.n.03

    • they analyzed the river into three parts
    • he needed a piece of granite

    Synonyms: piece

  4. 4

    that which concerns a person with regard to a particular role or situation

    part%1:09:02:: · part.n.04

    • it requires vigilance on our part
    • they resisted every effort on his part
  5. 5

    the extended spatial location of something

    part%1:15:00:: · region.n.01

    • the farming regions of France
    • religions in all parts of the world

    Synonyms: region

  6. 6

    the actions and activities assigned to or required or expected of a person or group

    part%1:04:01:: · function.n.03

    • the function of a teacher
    • the government must do its part

    Synonyms: function, office, role

  7. 7

    an actor's portrayal of someone in a play

    part%1:09:01:: · character.n.04

    • she played the part of Desdemona

    Synonyms: character, role, theatrical role, persona

  8. 8

    assets belonging to or due to or contributed by an individual person or group

    part%1:21:00:: · share.n.01

    • he wanted his share in cash

    Synonyms: share, portion, percentage

  9. 9

    one of the portions into which something is regarded as divided and which together constitute a whole

    part%1:09:00:: · part.n.09

    • the written part of the exam
    • the finance section of the company

    Synonyms: section, division

    Selected
  10. 10

    a line of scalp that can be seen when sections of hair are combed in opposite directions

    part%1:08:01:: · part.n.10

    • his part was right in the middle

    Synonyms: parting

  11. 11

    the melody carried by a particular voice or instrument in polyphonic music

    part%1:10:00:: · part.n.11

    • he tried to sing the tenor part

    Synonyms: voice

  12. 12

    the part played by a person in bringing about a result

    part%1:04:03:: · contribution.n.01

    • I am proud of my contribution in advancing the project
    • they all did their share of the work

    Synonyms: contribution, share

round Noun

Instance: semeval2013.d006.s020.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

So that, by passing rounds, it is not so clear that it is an advantage.

Show raw prompt

user

Which numbered sense of "round" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: So that, by passing <t>rounds</t>, it is not so clear that it is an advantage.

Senses:
1. definition=a charge of ammunition for a single shot
2. definition=an interval during which a recurring sequence of events occurs | examples=the never-ending cycle of the seasons
3. definition=a regular route for a sentry or policeman | examples=in the old days a policeman walked a beat and knew all his people by name
4. definition=(often plural) a series of professional calls (usually in a set order) | examples=the doctor goes on his rounds first thing every morning
5. definition=the activity of playing 18 holes of golf | examples=a round of golf takes about 4 hours
6. definition=the usual activities in your day | examples=the doctor made his rounds
7. definition=(sports) a division during which one team is on the offensive
8. definition=the course along which communications spread | examples=the story is going the rounds in Washington
9. definition=a serving to each of a group (usually alcoholic) | examples=he ordered a second round
10. definition=a cut of beef between the rump and the lower leg
11. definition=a partsong in which voices follow each other; one voice starts and others join in one after another until all are singing different parts of the song at the same time | examples=they enjoyed singing rounds
12. definition=an outburst of applause | examples=there was a round of applause
13. definition=a crosspiece between the legs of a chair
14. definition=any circular or rotating mechanism | examples=the machine punched out metal circles

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a charge of ammunition for a single shot

    round%1:06:01:: · round.n.01

    Synonyms: unit of ammunition, one shot

  2. 2

    an interval during which a recurring sequence of events occurs

    round%1:28:01:: · cycle.n.01

    • the never-ending cycle of the seasons

    Synonyms: cycle, rhythm

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    a regular route for a sentry or policeman

    round%1:15:00:: · beat.n.01

    • in the old days a policeman walked a beat and knew all his people by name

    Synonyms: beat

  4. 4

    (often plural) a series of professional calls (usually in a set order)

    round%1:04:00:: · round.n.04

    • the doctor goes on his rounds first thing every morning
    • the postman's rounds
  5. 5

    the activity of playing 18 holes of golf

    round%1:04:03:: · round_of_golf.n.01

    • a round of golf takes about 4 hours

    Synonyms: round of golf

  6. 6

    the usual activities in your day

    round%1:04:01:: · round.n.06

    • the doctor made his rounds

    Synonyms: daily round

  7. 7

    (sports) a division during which one team is on the offensive

    round%1:28:00:: · turn.n.09

    Synonyms: turn, bout

  8. 8

    the course along which communications spread

    round%1:17:00:: · round.n.08

    • the story is going the rounds in Washington
  9. 9

    a serving to each of a group (usually alcoholic)

    round%1:13:01:: · round.n.09

    • he ordered a second round

    Synonyms: round of drinks

    Selected
  10. 10

    a cut of beef between the rump and the lower leg

    round%1:13:00:: · round.n.10

  11. 11

    a partsong in which voices follow each other; one voice starts and others join in one after another until all are singing different parts of the song at the same time

    round%1:10:00:: · round.n.11

    • they enjoyed singing rounds

    Synonyms: troll

  12. 12

    an outburst of applause

    round%1:10:01:: · round.n.12

    • there was a round of applause
  13. 13

    a crosspiece between the legs of a chair

    round%1:06:03:: · rung.n.01

    Synonyms: rung, stave

  14. 14

    any circular or rotating mechanism

    round%1:06:00:: · circle.n.08

    • the machine punched out metal circles

    Synonyms: circle

figure Noun

Instance: semeval2013.d008.s013.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Some 44% of respondents across the region pronounced themselves satisfied with how their country's democracy works in practice, the same figure as last year but a big increase on the 25% in 2001 (chart 3).

Show raw prompt

user

Which numbered sense of "figure" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Some 44% of respondents across the region pronounced themselves satisfied with how their country's democracy works in practice, the same <t>figure</t> as last year but a big increase on the 25% in 2001 (chart 3).

Senses:
1. definition=a diagram or picture illustrating textual material | examples=the area covered can be seen from Figure 2
2. definition=alternative names for the body of a human being | examples=Leonardo studied the human body
3. definition=one of the elements that collectively form a system of numeration | examples=0 and 1 are digits
4. definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
5. definition=a well-known or notable person | examples=they studied all the great names in the history of France
6. definition=a combination of points and lines and planes that form a visible palpable shape
7. definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
8. definition=the impression produced by a person | examples=he cut a fine figure
9. definition=the property possessed by a sum or total or indefinite quantity of units or individuals | examples=he had a number of chores to do
10. definition=language used in a figurative or nonliteral sense
11. definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground
12. definition=a decorative or artistic work | examples=the coach had a design on the doors
13. definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  2. 2

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  3. 3

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  4. 4

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  5. 5

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  6. 6

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

  7. 7

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
    Selected
  8. 8

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  9. 9

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  11. 11

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

  12. 12

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  13. 13

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures

case Noun

Instance: semeval2013.d008.s014.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Some 34% said they had confidence in their country's Congress and 45% in their government, the same as last year in both cases but up sharply from 2003 (17% and 24% respectively).

Show raw prompt

user

Which numbered sense of "case" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Some 34% said they had confidence in their country's Congress and 45% in their government, the same as last year in both <t>cases</t> but up sharply from 2003 (17% and 24% respectively).

Senses:
1. definition=an occurrence of something | examples=it was a case of bad judgment
2. definition=a special set of circumstances | examples=in that event, the first possibility is excluded
3. definition=a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy | examples=the family brought suit against the landlord
4. definition=the actual state of things | examples=that was not the case
5. definition=a portable container for carrying several objects | examples=the musicians left their instrument cases backstage
6. definition=a person requiring professional services | examples=a typical case was the suburban housewife described by a marriage counselor
7. definition=a person who is subjected to experimental or other observational procedures; someone who is an object of investigation | examples=the subjects for this investigation were selected randomly
8. definition=a problem requiring investigation | examples=Perry Mason solved the case of the missing heir
9. definition=a statement of facts and reasons used to support an argument | examples=he stated his case clearly
10. definition=the quantity contained in a case
11. definition=nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence
12. definition=a specific state of mind that is temporary | examples=a case of the jitters
13. definition=a person of a specified kind (usually with many eccentricities) | examples=a real character
14. definition=a specific size and style of type within a type family
15. definition=an enveloping structure or covering enclosing an animal or plant organ or part
16. definition=the housing or outer covering of something | examples=the clock has a walnut case
17. definition=the enclosing frame around a door or window opening | examples=the casings had rotted away and had to be replaced
18. definition=(printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers | examples=for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters
19. definition=bed linen consisting of a cover for a pillow | examples=the burglar carried his loot in a pillowcase
20. definition=a glass container used to store and display items in a shop or museum or home

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an occurrence of something

    case%1:11:00:: · case.n.01

    • it was a case of bad judgment
    • another instance occurred yesterday

    Synonyms: instance, example

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a special set of circumstances

    case%1:26:00:: · event.n.02

    • in that event, the first possibility is excluded
    • it may rain in which case the picnic will be canceled

    Synonyms: event

    Selected
  3. 3

    a comprehensive term for any proceeding in a court of law whereby an individual seeks a legal remedy

    case%1:04:00:: · lawsuit.n.01

    • the family brought suit against the landlord

    Synonyms: lawsuit, suit, cause, causa

  4. 4

    the actual state of things

    case%1:09:00:: · case.n.04

    • that was not the case
  5. 5

    a portable container for carrying several objects

    case%1:06:00:: · case.n.05

    • the musicians left their instrument cases backstage
  6. 6

    a person requiring professional services

    case%1:18:03:: · case.n.06

    • a typical case was the suburban housewife described by a marriage counselor
  7. 7

    a person who is subjected to experimental or other observational procedures; someone who is an object of investigation

    case%1:18:02:: · subject.n.06

    • the subjects for this investigation were selected randomly
    • the cases that we studied were drawn from two different communities

    Synonyms: subject, guinea pig

  8. 8

    a problem requiring investigation

    case%1:10:02:: · case.n.08

    • Perry Mason solved the case of the missing heir
  9. 9

    a statement of facts and reasons used to support an argument

    case%1:10:01:: · case.n.09

    • he stated his case clearly
  10. 10

    the quantity contained in a case

    case%1:23:00:: · case.n.10

    Synonyms: caseful

  11. 11

    nouns or pronouns or adjectives (often marked by inflection) related in some way to other words in a sentence

    case%1:10:00:: · case.n.11

    Synonyms: grammatical case

  12. 12

    a specific state of mind that is temporary

    case%1:26:02:: · case.n.12

    • a case of the jitters
  13. 13

    a person of a specified kind (usually with many eccentricities)

    case%1:18:04:: · character.n.05

    • a real character
    • a strange character

    Synonyms: character, eccentric, type

  14. 14

    a specific size and style of type within a type family

    case%1:10:03:: · font.n.01

    Synonyms: font, fount, typeface, face

  15. 15

    an enveloping structure or covering enclosing an animal or plant organ or part

    case%1:08:00:: · sheath.n.02

    Synonyms: sheath

  16. 16

    the housing or outer covering of something

    case%1:06:06:: · shell.n.08

    • the clock has a walnut case

    Synonyms: shell, casing

  17. 17

    the enclosing frame around a door or window opening

    case%1:06:07:: · casing.n.03

    • the casings had rotted away and had to be replaced

    Synonyms: casing

  18. 18

    (printing) the receptacle in which a compositor has his type, which is divided into compartments for the different letters, spaces, or numbers

    case%1:06:03:: · case.n.18

    • for English, a compositor will ordinarily have two such cases, the upper case containing the capitals and the lower case containing the small letters

    Synonyms: compositor's case, typesetter's case

  19. 19

    bed linen consisting of a cover for a pillow

    case%1:06:02:: · case.n.19

    • the burglar carried his loot in a pillowcase

    Synonyms: pillowcase, slip, pillow slip

  20. 20

    a glass container used to store and display items in a shop or museum or home

    case%1:06:01:: · case.n.20

    Synonyms: display case, showcase, vitrine

figure Noun

Instance: semeval2013.d008.s023.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Some 31% say that either they or a close relative have been victims of crime over the past year, but that is down from 38% last year and is the lowest figure since 1995.

Show raw prompt

user

Which numbered sense of "figure" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Some 31% say that either they or a close relative have been victims of crime over the past year, but that is down from 38% last year and is the lowest <t>figure</t> since 1995.

Senses:
1. definition=a diagram or picture illustrating textual material | examples=the area covered can be seen from Figure 2
2. definition=alternative names for the body of a human being | examples=Leonardo studied the human body
3. definition=one of the elements that collectively form a system of numeration | examples=0 and 1 are digits
4. definition=a model of a bodily form (especially of a person) | examples=he made a figure of Santa Claus
5. definition=a well-known or notable person | examples=they studied all the great names in the history of France
6. definition=a combination of points and lines and planes that form a visible palpable shape
7. definition=an amount of money expressed numerically | examples=a figure of $17 was suggested
8. definition=the impression produced by a person | examples=he cut a fine figure
9. definition=the property possessed by a sum or total or indefinite quantity of units or individuals | examples=he had a number of chores to do
10. definition=language used in a figurative or nonliteral sense
11. definition=a unitary percept having structure and coherence that is the object of attention and that stands out against a ground
12. definition=a decorative or artistic work | examples=the coach had a design on the doors
13. definition=a predetermined set of movements in dancing or skating | examples=she made the best score on compulsory figures

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a diagram or picture illustrating textual material

    figure%1:10:00:: · figure.n.01

    • the area covered can be seen from Figure 2

    Synonyms: fig

  2. 2

    alternative names for the body of a human being

    figure%1:08:00:: · human_body.n.01

    • Leonardo studied the human body
    • he has a strong physique

    Synonyms: human body, physical body, material body, soma, build, physique, anatomy, shape, bod, chassis, frame, form, flesh

  3. 3

    one of the elements that collectively form a system of numeration

    figure%1:23:00:: · digit.n.01

    • 0 and 1 are digits

    Synonyms: digit

  4. 4

    a model of a bodily form (especially of a person)

    figure%1:06:00:: · figure.n.04

    • he made a figure of Santa Claus
  5. 5

    a well-known or notable person

    figure%1:18:00:: · name.n.04

    • they studied all the great names in the history of France
    • she is an important figure in modern music

    Synonyms: name, public figure

  6. 6

    a combination of points and lines and planes that form a visible palpable shape

    figure%1:25:00:: · figure.n.06

  7. 7

    an amount of money expressed numerically

    figure%1:21:00:: · figure.n.07

    • a figure of $17 was suggested
    Selected
  8. 8

    the impression produced by a person

    figure%1:07:00:: · figure.n.08

    • he cut a fine figure
    • a heroic figure
  9. 9

    the property possessed by a sum or total or indefinite quantity of units or individuals

    figure%1:07:01:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: number

    Gold lexEN Gold Maru 2022 Gold Raganato
  10. 10

    language used in a figurative or nonliteral sense

    figure%1:10:01:: · trope.n.01

    Synonyms: trope, figure of speech, image

  11. 11

    a unitary percept having structure and coherence that is the object of attention and that stands out against a ground

    figure%1:09:00:: · figure.n.11

  12. 12

    a decorative or artistic work

    figure%1:06:01:: · design.n.04

    • the coach had a design on the doors

    Synonyms: design, pattern

  13. 13

    a predetermined set of movements in dancing or skating

    figure%1:04:00:: · figure.n.13

    • she made the best score on compulsory figures

court Noun

Instance: semeval2013.d009.s017.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

"This stunning breach of ethics and indifference to the code belies claims by several justices that the court abides by the same rules that apply to all other federal judges," said Bob Edgar, the president of Common Cause.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: "This stunning breach of ethics and indifference to the code belies claims by several justices that the <t>court</t> abides by the same rules that apply to all other federal judges," said Bob Edgar, the president of Common Cause.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business
2. definition=a room in which a lawcourt sits | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947)
6. definition=the family and retinue of a sovereign or prince
7. definition=a hotel for motorists; provides direct access from rooms to parking area
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | examples=the house was built around an inner court
11. definition=respectful deference | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

court Noun

Instance: semeval2013.d009.s018.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

"The justices were wining and dining at a black-tie fundraiser with attorneys who have pending cases before the court."

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: "The justices were wining and dining at a black-tie fundraiser with attorneys who have pending cases before the <t>court</t>."

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business
2. definition=a room in which a lawcourt sits | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947)
6. definition=the family and retinue of a sovereign or prince
7. definition=a hotel for motorists; provides direct access from rooms to parking area
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | examples=the house was built around an inner court
11. definition=respectful deference | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

court Noun

Instance: semeval2013.d009.s020.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Scalia and Thomas have shown little regard for critics who say they too readily mix the business of the court with agenda-driven groups such as the Federalist Society.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Scalia and Thomas have shown little regard for critics who say they too readily mix the business of the <t>court</t> with agenda-driven groups such as the Federalist Society.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business
2. definition=a room in which a lawcourt sits | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947)
6. definition=the family and retinue of a sovereign or prince
7. definition=a hotel for motorists; provides direct access from rooms to parking area
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | examples=the house was built around an inner court
11. definition=respectful deference | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

number Noun

Instance: semeval2013.d010.s013.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Almost near the centennial number is Carles Puyol, with 97 games.

Show raw prompt

user

Which numbered sense of "number" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Almost near the centennial <t>number</t> is Carles Puyol, with 97 games.

Senses:
1. definition=the property possessed by a sum or total or indefinite quantity of units or individuals | examples=he had a number of chores to do
2. definition=a concept of quantity involving zero and units | examples=every number has a unique position in the sequence
3. definition=a short theatrical performance that is part of a longer program | examples=he did his act three times every evening
4. definition=the number is used in calling a particular telephone | examples=he has an unlisted number
5. definition=a symbol used to represent a number | examples=he learned to write the numerals before he went to school
6. definition=one of a series published periodically | examples=she found an old issue of the magazine in her dentist's waiting room
7. definition=a select company of people | examples=I hope to become one of their number before I die
8. definition=a numeral or string of numerals that is used for identification | examples=she refused to give them her Social Security number
9. definition=a clothing measurement | examples=a number 13 shoe
10. definition=the grammatical category for the forms of nouns and pronouns and verbs that are used depending on the number of entities involved (singular or dual or plural) | examples=in English the subject and the verb must agree in number
11. definition=an item of merchandise offered for sale | examples=she preferred the black nylon number

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the property possessed by a sum or total or indefinite quantity of units or individuals

    number%1:07:00:: · number.n.01

    • he had a number of chores to do
    • the number of parameters is small

    Synonyms: figure

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a concept of quantity involving zero and units

    number%1:23:00:: · number.n.02

    • every number has a unique position in the sequence
    Selected
  3. 3

    a short theatrical performance that is part of a longer program

    number%1:10:04:: · act.n.04

    • he did his act three times every evening
    • she had a catchy little routine

    Synonyms: act, routine, turn, bit

  4. 4

    the number is used in calling a particular telephone

    number%1:10:03:: · phone_number.n.01

    • he has an unlisted number

    Synonyms: phone number, telephone number

  5. 5

    a symbol used to represent a number

    number%1:10:01:: · numeral.n.01

    • he learned to write the numerals before he went to school

    Synonyms: numeral

  6. 6

    one of a series published periodically

    number%1:10:00:: · issue.n.02

    • she found an old issue of the magazine in her dentist's waiting room

    Synonyms: issue

  7. 7

    a select company of people

    number%1:14:00:: · number.n.07

    • I hope to become one of their number before I die
  8. 8

    a numeral or string of numerals that is used for identification

    number%1:10:02:: · number.n.08

    • she refused to give them her Social Security number

    Synonyms: identification number

  9. 9

    a clothing measurement

    number%1:07:01:: · number.n.09

    • a number 13 shoe
  10. 10

    the grammatical category for the forms of nouns and pronouns and verbs that are used depending on the number of entities involved (singular or dual or plural)

    number%1:10:05:: · number.n.10

    • in English the subject and the verb must agree in number
  11. 11

    an item of merchandise offered for sale

    number%1:06:00:: · number.n.11

    • she preferred the black nylon number
    • this sweater is an all-wool number