Verified run

gemini/gemini-3.1-pro-preview

gemini-3.1-pro-low-reasoning-p003-lexen-v1-20260616

Rank
15
Accuracy lexEN v1 · WordNet fine
94.40%
Correct
4589 / 4861
Actual run cost
$14.98
Cost / M items
$3,081

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 94.40% 4589 / 4861 98.64% 4795 / 4861 96.63% 4697 / 4861
Maru 2022 (ALLamended) 91.38% 4442 / 4861 97.57% 4743 / 4861 94.82% 4609 / 4861
Raganato 2017 (original) 84.84% 4124 / 4861 94.63% 4600 / 4861 90.54% 4401 / 4861

Model

Display
gemini/gemini-3.1-pro-preview
Requested
gemini/gemini-3.1-pro-preview
Resolved
gemini-3.1-pro-preview
Vendor
Google
API provider
Google
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
low
Model URL
n/a
Endpoint
n/a
Resolved counts
gemini-3.1-pro-preview: 4859

Reproducibility

Created
2026-06-16T02:21:16.914989+00:00
Run schema
sensebench-run-v2
Commit
5b012ea5d171aa1bd85b19f9ecd80276014f38d9
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p003
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
3,885,720
Tokens / item
799.4
Total cost
$14.98
Cost / M items
$3,081
Cost source
litellm_estimate
Elapsed
20.28m
Success items
4,859
Monosemous
0
No candidates
0
No valid vote
2
Invalid votes
0
Transport errors
2

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
12,288
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $14.98. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 2,091,720 $4.18 $2.00
Input cached n/a $0.00 $0.200
Output 899,339 $10.79 $12.00
Reasoning output 894,661 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 91.31% 725 794
Candidate Count 2 96.96% 829 855
Candidate Count 3-5 94.86% 1845 1945
Candidate Count 6-10 93.92% 1190 1267
POS ADJ 95.14% 627 659
POS ADV 92.82% 181 195
POS NOUN 95.03% 2753 2897
POS VERB 92.61% 1028 1110
Source Dataset semeval2013 95.26% 1086 1140
Source Dataset semeval2015 93.78% 693 739
Source Dataset senseval2 94.41% 1538 1629
Source Dataset senseval3 94.01% 1272 1353

Worst-Bucket Examples

top Noun

Instance: semeval2013.d001.s001.t007 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Baskonia gives away a victory in Israel

Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the top of their group.

The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Show raw prompt

user

Which numbered sense of "top" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Baskonia gives away a victory in Israel Caja Laboral achieved a stunning 82-91 victory on their visit to the Maccabee Electra court despite Dusko Ivanovic's team's heavy losses, and after the great performance by Mizra Teltovic, who was the best on his team with eight three-pointers scored (29 points), they now at the <t>top</t> of their group. The Vitorian team knew to make up for the significant absences of Herrmann, Oleson, Huertas and Micov with a big dose of involvement and teamwork, even though it had to hold out until the end to take the victory.

Senses:
1. definition=the upper part of anything | examples=the mower cuts off the tops of the grass; the title should be written at the top of the first page
2. definition=the highest or uppermost side of anything | synonyms=top side, upper side, upside | examples=put your books on top of the desk; only the top side of the box was painted
3. definition=the top or extreme point of something (usually a mountain or hill) | synonyms=peak, crown, crest, tip, summit | examples=the view from the peak was magnificent; they clambered to the tip of Monadnock
4. definition=the first half of an inning; while the visiting team is at bat | synonyms=top of the inning | examples=a relief pitcher took over in the top of the fifth
5. definition=the highest level or degree attainable; the highest stage of development | synonyms=acme, height, elevation, peak, pinnacle, summit | examples=his landscapes were deemed the acme of beauty; the artist's gifts are at their acme
6. definition=the greatest possible intensity | examples=he screamed at the top of his lungs
7. definition=platform surrounding the head of a lower mast
8. definition=a conical child's plaything tapering to a steel point on which it can be made to spin | synonyms=whirligig, teetotum, spinning top | examples=he got a bright red top and string for his birthday
9. definition=covering for a hole (especially a hole in the top of a container) | synonyms=cover | examples=he removed the top of the carton; he couldn't get the top off of the bottle
10. definition=a garment (especially for women) that extends from the shoulders to the waist or hips | examples=he stared as she buttoned her top
11. definition=a canvas tent to house the audience at a circus performance | synonyms=circus tent, big top, round top | examples=he was afraid of a fire in the circus tent; they had the big top up in less than an hour

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    the upper part of anything

    top%1:15:01:: · top.n.01

    • the mower cuts off the tops of the grass
    • the title should be written at the top of the first page
    Selected
  2. 2

    the highest or uppermost side of anything

    top%1:15:00:: · top.n.02

    • put your books on top of the desk
    • only the top side of the box was painted

    Synonyms: top side, upper side, upside

  3. 3

    the top or extreme point of something (usually a mountain or hill)

    top%1:15:02:: · peak.n.04

    • the view from the peak was magnificent
    • they clambered to the tip of Monadnock

    Synonyms: peak, crown, crest, tip, summit

  4. 4

    the first half of an inning; while the visiting team is at bat

    top%1:28:00:: · top.n.04

    • a relief pitcher took over in the top of the fifth

    Synonyms: top of the inning

  5. 5

    the highest level or degree attainable; the highest stage of development

    top%1:26:00:: · acme.n.01

    • his landscapes were deemed the acme of beauty
    • the artist's gifts are at their acme

    Synonyms: acme, height, elevation, peak, pinnacle, summit, superlative, meridian, tiptop

    Gold lexEN Gold Maru 2022 Gold Raganato
  6. 6

    the greatest possible intensity

    top%1:07:02:: · top.n.06

    • he screamed at the top of his lungs
  7. 7

    platform surrounding the head of a lower mast

    top%1:06:04:: · top.n.07

  8. 8

    a conical child's plaything tapering to a steel point on which it can be made to spin

    top%1:06:03:: · top.n.08

    • he got a bright red top and string for his birthday

    Synonyms: whirligig, teetotum, spinning top

  9. 9

    covering for a hole (especially a hole in the top of a container)

    top%1:06:01:: · top.n.09

    • he removed the top of the carton
    • he couldn't get the top off of the bottle

    Synonyms: cover

  10. 10

    a garment (especially for women) that extends from the shoulders to the waist or hips

    top%1:06:00:: · top.n.10

    • he stared as she buttoned her top
  11. 11

    a canvas tent to house the audience at a circus performance

    top%1:06:02:: · circus_tent.n.01

    • he was afraid of a fire in the circus tent
    • they had the big top up in less than an hour

    Synonyms: circus tent, big top, round top

charge Noun

Instance: semeval2013.d004.s004.t007 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

US banks repay state support

The crisis-hit US major banks are breaking free from their state shackles.

On Wednesday Bank of America repaid the support from the bank protection fund TARP in the amount USD 45 billion (nearly EUR 30 billion) in one go.

And, according to reports from US broadcaster CNBC, Citigroup is also planning to repay the state support.

The institutions thereby want to wiggle themselves free from the restrictions going hand-in-hand with the acceptance of the money, such as the limits on manager bonuses and the paying of high charges.

Bank of America had raised some USD 19 billion from investors through convertible loans.

Show raw prompt

user

Which numbered sense of "charge" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: US banks repay state support The crisis-hit US major banks are breaking free from their state shackles. On Wednesday Bank of America repaid the support from the bank protection fund TARP in the amount USD 45 billion (nearly EUR 30 billion) in one go. And, according to reports from US broadcaster CNBC, Citigroup is also planning to repay the state support. The institutions thereby want to wiggle themselves free from the restrictions going hand-in-hand with the acceptance of the money, such as the limits on manager bonuses and the paying of high <t>charges</t>. Bank of America had raised some USD 19 billion from investors through convertible loans.

Senses:
1. definition=an impetuous rush toward someone or something | examples=the wrestler's charge carried him past his adversary; the battle began with a cavalry charge
2. definition=(criminal law) a pleading describing some wrong or offense | synonyms=complaint | examples=he was arrested on a charge of larceny
3. definition=the price charged for some article or service | examples=the admission charge
4. definition=the quantity of unbalanced electricity in a body (either positive or negative) and construed as an excess or deficiency of electrons | synonyms=electric charge | examples=the battery needed a fresh charge
5. definition=attention and management implying responsibility for safety | synonyms=care, tutelage, guardianship | examples=he is in the care of a bodyguard
6. definition=a special assignment that is given to a person or group | synonyms=mission, commission | examples=a confidential mission to London; his charge was deliver a message
7. definition=a person committed to your care | examples=the teacher led her charges across the street
8. definition=financial liabilities (such as a tax) | examples=the charges against the estate
9. definition=(psychoanalysis) the libidinal energy invested in some idea or person or object | synonyms=cathexis | examples=Freud thought of cathexis as a psychic analog of an electrical charge
10. definition=the swift release of a store of affective force | synonyms=bang, boot, rush, flush, thrill, kick | examples=they got a great bang out of it; what a boot!
11. definition=request for payment of a debt | synonyms=billing | examples=they submitted their charges at the end of each month
12. definition=a formal statement of a command or injunction to do something | synonyms=commission, direction | examples=the judge's charge to the jury
13. definition=an assertion that someone is guilty of a fault or offence | synonyms=accusation | examples=the newspaper published charges that Jones was guilty of drunken driving
14. definition=heraldry consisting of a design or image depicted on a shield | synonyms=bearing, heraldic bearing, armorial bearing
15. definition=a quantity of explosive to be set off at one time | synonyms=burster, bursting charge, explosive charge | examples=this cartridge has a powder charge of 50 grains

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an impetuous rush toward someone or something

    charge%1:04:01:: · charge.n.01

    • the wrestler's charge carried him past his adversary
    • the battle began with a cavalry charge
  2. 2

    (criminal law) a pleading describing some wrong or offense

    charge%1:10:00:: · charge.n.02

    • he was arrested on a charge of larceny

    Synonyms: complaint

  3. 3

    the price charged for some article or service

    charge%1:21:02:: · charge.n.03

    • the admission charge
    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    the quantity of unbalanced electricity in a body (either positive or negative) and construed as an excess or deficiency of electrons

    charge%1:19:00:: · charge.n.04

    • the battery needed a fresh charge

    Synonyms: electric charge

  5. 5

    attention and management implying responsibility for safety

    charge%1:04:00:: · care.n.05

    • he is in the care of a bodyguard

    Synonyms: care, tutelage, guardianship

  6. 6

    a special assignment that is given to a person or group

    charge%1:04:03:: · mission.n.03

    • a confidential mission to London
    • his charge was deliver a message

    Synonyms: mission, commission

  7. 7

    a person committed to your care

    charge%1:18:00:: · charge.n.07

    • the teacher led her charges across the street
  8. 8

    financial liabilities (such as a tax)

    charge%1:21:01:: · charge.n.08

    • the charges against the estate
    Selected
  9. 9

    (psychoanalysis) the libidinal energy invested in some idea or person or object

    charge%1:16:00:: · cathexis.n.01

    • Freud thought of cathexis as a psychic analog of an electrical charge

    Synonyms: cathexis

  10. 10

    the swift release of a store of affective force

    charge%1:12:00:: · bang.n.04

    • they got a great bang out of it
    • what a boot!

    Synonyms: bang, boot, rush, flush, thrill, kick

  11. 11

    request for payment of a debt

    charge%1:10:03:: · charge.n.11

    • they submitted their charges at the end of each month

    Synonyms: billing

  12. 12

    a formal statement of a command or injunction to do something

    charge%1:10:01:: · commission.n.06

    • the judge's charge to the jury

    Synonyms: commission, direction

  13. 13

    an assertion that someone is guilty of a fault or offence

    charge%1:10:04:: · accusation.n.02

    • the newspaper published charges that Jones was guilty of drunken driving

    Synonyms: accusation

  14. 14

    heraldry consisting of a design or image depicted on a shield

    charge%1:06:01:: · charge.n.14

    Synonyms: bearing, heraldic bearing, armorial bearing

  15. 15

    a quantity of explosive to be set off at one time

    charge%1:06:00:: · charge.n.15

    • this cartridge has a powder charge of 50 grains

    Synonyms: burster, bursting charge, explosive charge

end Noun

Instance: semeval2013.d005.s004.t004 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Cheshire Appeal Will Point to Twitter

There were half a dozen of them typing away in the courtroom rows.

Minute by minute, they sent out reports of gruesome testimony via Twitter.

In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze.

On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury.

But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years.

Show raw prompt

user

Which numbered sense of "end" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Cheshire Appeal Will Point to Twitter There were half a dozen of them typing away in the courtroom rows. Minute by minute, they sent out reports of gruesome testimony via Twitter. In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze. On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official <t>end</t> with the judge's imposition of the death sentence voted for by the jury. But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years.

Senses:
1. definition=either extremity of something that has length | synonyms=terminal | examples=the end of the pier; she knotted the end of the thread
2. definition=the point in time at which something ends | synonyms=ending | examples=the end of the year; the ending of warranty period
3. definition=the concluding parts of an event or occurrence | synonyms=last, final stage | examples=the end was exciting; I had to miss the last of the movie
4. definition=the state of affairs that a plan is intended to achieve and that (when achieved) terminates behavior intended to achieve it | synonyms=goal | examples=the ends justify the means
5. definition=a final part or section | examples=we have given it at the end of the section since it involves the calculus; Start at the beginning and go on until you come to the end
6. definition=a final state | synonyms=destruction, death | examples=he came to a bad end; the so-called glorious experiment came to an inglorious end
7. definition=the surface at either extremity of a three-dimensional object | examples=one end of the box was marked `This side up'
8. definition=(football) the person who plays at one end of the line of scrimmage | examples=the end managed to hold onto the pass
9. definition=a boundary marking the extremities of something | examples=the end of town
10. definition=one of two places from which people are communicating to each other | examples=the phone rang at the other end; both ends wrote at the same time
11. definition=the part you are expected to play | examples=he held up his end
12. definition=the last section of a communication | synonyms=conclusion, close, closing, ending | examples=in conclusion I want to say...
13. definition=a piece of cloth that is left over after the rest has been used or sold | synonyms=remainder, remnant, oddment
14. definition=(American football) a position on the line of scrimmage | examples=no one wanted to play end

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    either extremity of something that has length

    end%1:15:00:: · end.n.01

    • the end of the pier
    • she knotted the end of the thread

    Synonyms: terminal

  2. 2

    the point in time at which something ends

    end%1:28:00:: · end.n.02

    • the end of the year
    • the ending of warranty period

    Synonyms: ending

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    the concluding parts of an event or occurrence

    end%1:11:00:: · end.n.03

    • the end was exciting
    • I had to miss the last of the movie

    Synonyms: last, final stage

    Gold lexEN Gold Maru 2022
  4. 4

    the state of affairs that a plan is intended to achieve and that (when achieved) terminates behavior intended to achieve it

    end%1:09:02:: · goal.n.01

    • the ends justify the means

    Synonyms: goal

  5. 5

    a final part or section

    end%1:09:00:: · end.n.05

    • we have given it at the end of the section since it involves the calculus
    • Start at the beginning and go on until you come to the end
  6. 6

    a final state

    end%1:26:00:: · end.n.06

    • he came to a bad end
    • the so-called glorious experiment came to an inglorious end

    Synonyms: destruction, death

    Selected
  7. 7

    the surface at either extremity of a three-dimensional object

    end%1:15:02:: · end.n.07

    • one end of the box was marked `This side up'
  8. 8

    (football) the person who plays at one end of the line of scrimmage

    end%1:18:00:: · end.n.08

    • the end managed to hold onto the pass
  9. 9

    a boundary marking the extremities of something

    end%1:15:01:: · end.n.09

    • the end of town
  10. 10

    one of two places from which people are communicating to each other

    end%1:15:03:: · end.n.10

    • the phone rang at the other end
    • both ends wrote at the same time
  11. 11

    the part you are expected to play

    end%1:04:00:: · end.n.11

    • he held up his end
  12. 12

    the last section of a communication

    end%1:10:00:: · conclusion.n.08

    • in conclusion I want to say...

    Synonyms: conclusion, close, closing, ending

  13. 13

    a piece of cloth that is left over after the rest has been used or sold

    end%1:06:02:: · end.n.13

    Synonyms: remainder, remnant, oddment

  14. 14

    (American football) a position on the line of scrimmage

    end%1:04:02:: · end.n.14

    • no one wanted to play end

court Noun

Instance: semeval2013.d005.s005.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Cheshire Appeal Will Point to Twitter

There were half a dozen of them typing away in the courtroom rows.

Minute by minute, they sent out reports of gruesome testimony via Twitter.

In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze.

On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury.

But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the courts for years.

One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Cheshire Appeal Will Point to Twitter There were half a dozen of them typing away in the courtroom rows. Minute by minute, they sent out reports of gruesome testimony via Twitter. In the end, the defense says, there were more than 140,000 Twitter messages about the trial that dealt with rape and children tied to their beds in a house that was set ablaze. On Thursday, the widely followed trial of Steven J. Hayes, who was convicted of killing three members of a Cheshire, Conn., family, is set to come to an official end with the judge's imposition of the death sentence voted for by the jury. But lawyers for Mr. Hayes have already made court filings that sketch out appeals arguments that are likely to occupy the <t>courts</t> for years. One of the most provocative is that the intense reporting on the trial - including mainstream reporters' extensive use of Twitter - created a "circus atmosphere" and such widespread, instant saturation with inflammatory details that the jury was improperly swayed by public passions.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

court Noun

Instance: semeval2013.d005.s027.t006 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

But their arguments about the effect of the intense coverage of the trial may draw the most interest.

They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

They argued that the news media continually fanned the flames of emotion about the case.

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: But their arguments about the effect of the intense coverage of the trial may draw the most interest. They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate. They argued that the news media continually fanned the flames of emotion about the case. "The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor <t>court</t> policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

court Noun

Instance: semeval2013.d005.s028.t005 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate.

They argued that the news media continually fanned the flames of emotion about the case.

"The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide."

Their focus on the Twitter coverage is controversial.

In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials.

But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the courts.

Mr. Hayes's lawyers are pressing that claim.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: They noted in a challenge to the verdict filed last month that the case dominated the news in Connecticut and was discussed during the election campaign by candidates for governor and the United States Senate. They argued that the news media continually fanned the flames of emotion about the case. "The daily crush of media tweets, cameras and reporters outside the courthouse," the lawyers wrote, "was unlike anything ever seen here in New Haven and maybe statewide." Their focus on the Twitter coverage is controversial. In interviews, some journalists said the claim that instant news was more incendiary than reports delivered more slowly was a Luddite view that would make poor court policy governing coverage of future trials. But some lawyers said appeals courts were often attracted to arguments that social and technological changes required adaptation by the <t>courts</t>. Mr. Hayes's lawyers are pressing that claim.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

rule Noun

Instance: semeval2013.d006.s007.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA.

As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them.

This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase.

Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players.

The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football.

It is so extended that it part of the ethos, of the unwritten rules, but followed nonetheless by this sport.

Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Show raw prompt

user

Which numbered sense of "rule" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: The expulsion presumably forged by two players of Real Madrid (Xabi Alonso and Sergio Ramos) in the game played on the 23rd of November against Ajax in European Champions League has caused rivers of ink to be written about if such behavior is or is not unsportsmanlike and if, both players should be sanctioned by UEFA. As we all know, a few minutes before the end of the game (that their team had already won), both players deliberately wasted time which made the referee show the second yellow card to both of them. This way, and since Real Madrid will finish as leader of its group, both players will fulfil the prescribed sanction during the next game of league, against Auxerre, and will be able to get rid of the cards the following phase. Finally, the committee of discipline of the UEFA has sanctioned with two games the trainer of the team, Jose Mourinho, and with different economic amounts the implied players. The provocation of a yellow card in similar circumstances as this one is not a new practice, but rather frequent in the world of football. It is so extended that it part of the ethos, of the unwritten <t>rules</t>, but followed nonetheless by this sport. Part of the debate arisen in the related case is caused by the fact that has been carried out by team of the Real Madrid organization (that in its hymn presumes of nobility and honor, and that has fined its players for analogous acts) and by the dramatization orchestrated, apparently, by Mourinho, who adds one more to his expanded history of histrionic and provoking technician.

Senses:
1. definition=a principle or condition that customarily governs behavior | synonyms=regulation | examples=it was his rule to take a walk before breakfast; short haircuts were the regulation
2. definition=something regarded as a normative example | synonyms=convention, normal, pattern, formula | examples=the convention of not naming the main character; violence is the rule not the exception
3. definition=prescribed guide for conduct or action | synonyms=prescript
4. definition=(linguistics) a rule describing (or prescribing) a linguistic practice | synonyms=linguistic rule
5. definition=a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct | synonyms=principle | examples=their principles of composition characterized all their works
6. definition=the duration of a monarch's or government's power | examples=during the rule of Elizabeth
7. definition=dominance or power through legal authority | synonyms=dominion | examples=France held undisputed dominion over vast areas of Africa; the rule of Caesar
8. definition=directions that define the way a game or sport is to be conducted | examples=he knew the rules of chess
9. definition=any one of a systematic body of regulations defining the way of life of members of a religious order | examples=the rule of St. Dominic
10. definition=a rule or law concerning a natural phenomenon or the function of a complex system | synonyms=principle | examples=the principle of the conservation of mass; the principle of jet propulsion
11. definition=(mathematics) a standard procedure for solving a class of mathematical problems | synonyms=formula | examples=he determined the upper bound with Descartes' rule of signs; he gave us a general formula for attacking polynomials
12. definition=measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths | synonyms=ruler

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    a principle or condition that customarily governs behavior

    rule%1:09:00:: · rule.n.01

    • it was his rule to take a walk before breakfast
    • short haircuts were the regulation

    Synonyms: regulation

    Gold Raganato Selected
  2. 2

    something regarded as a normative example

    rule%1:09:01:: · convention.n.02

    • the convention of not naming the main character
    • violence is the rule not the exception

    Synonyms: convention, normal, pattern, formula

  3. 3

    prescribed guide for conduct or action

    rule%1:10:00:: · rule.n.03

    Synonyms: prescript

  4. 4

    (linguistics) a rule describing (or prescribing) a linguistic practice

    rule%1:10:01:: · rule.n.04

    Synonyms: linguistic rule

  5. 5

    a basic generalization that is accepted as true and that can be used as a basis for reasoning or conduct

    rule%1:09:03:: · principle.n.01

    • their principles of composition characterized all their works

    Synonyms: principle

  6. 6

    the duration of a monarch's or government's power

    rule%1:28:00:: · rule.n.06

    • during the rule of Elizabeth
  7. 7

    dominance or power through legal authority

    rule%1:26:00:: · dominion.n.01

    • France held undisputed dominion over vast areas of Africa
    • the rule of Caesar

    Synonyms: dominion

  8. 8

    directions that define the way a game or sport is to be conducted

    rule%1:10:02:: · rule.n.08

    • he knew the rules of chess
    Gold lexEN Gold Maru 2022
  9. 9

    any one of a systematic body of regulations defining the way of life of members of a religious order

    rule%1:10:03:: · rule.n.09

    • the rule of St. Dominic
  10. 10

    a rule or law concerning a natural phenomenon or the function of a complex system

    rule%1:09:02:: · principle.n.04

    • the principle of the conservation of mass
    • the principle of jet propulsion

    Synonyms: principle

  11. 11

    (mathematics) a standard procedure for solving a class of mathematical problems

    rule%1:09:04:: · rule.n.11

    • he determined the upper bound with Descartes' rule of signs
    • he gave us a general formula for attacking polynomials

    Synonyms: formula

  12. 12

    measuring stick consisting of a strip of wood or metal or plastic with a straight edge that is used for drawing straight lines and measuring lengths

    rule%1:06:00:: · rule.n.12

    Synonyms: ruler

round Noun

Instance: semeval2013.d006.s020.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Another question is what type of advantage the violators obtained in the actions deliberately carried out.

Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same game, because evidently the result of the action supposes leaving their own team with less players.

And neither is it a useful strategy for the next game, because the club will not be able to count on those players.

The advantage, obviously, consists in the fact that the players will begin the following phase of the Championship without cards that could threaten their participation in a future game.

But it is about a long term advantage, with a certain degree of indetermination, because the team can be eliminated first of change, and in addition with this action the players fulfil a sanction game and go to the second cycle of cards, in which the suspension by card accumulation takes place with one less than in the first cycle.

So that, by passing rounds, it is not so clear that it is an advantage.

Those actions are really against the sporting spirit, which is part of the strategic decisions that favor taking advantages allowed by the rules.

Show raw prompt

user

Which numbered sense of "round" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Another question is what type of advantage the violators obtained in the actions deliberately carried out. Here it seems necessary to state that it isn't a disadvantageous situation for rival nor is an obtained benefit in the same game, because evidently the result of the action supposes leaving their own team with less players. And neither is it a useful strategy for the next game, because the club will not be able to count on those players. The advantage, obviously, consists in the fact that the players will begin the following phase of the Championship without cards that could threaten their participation in a future game. But it is about a long term advantage, with a certain degree of indetermination, because the team can be eliminated first of change, and in addition with this action the players fulfil a sanction game and go to the second cycle of cards, in which the suspension by card accumulation takes place with one less than in the first cycle. So that, by passing <t>rounds</t>, it is not so clear that it is an advantage. Those actions are really against the sporting spirit, which is part of the strategic decisions that favor taking advantages allowed by the rules.

Senses:
1. definition=a charge of ammunition for a single shot | synonyms=unit of ammunition, one shot
2. definition=an interval during which a recurring sequence of events occurs | synonyms=cycle, rhythm | examples=the never-ending cycle of the seasons
3. definition=a regular route for a sentry or policeman | synonyms=beat | examples=in the old days a policeman walked a beat and knew all his people by name
4. definition=(often plural) a series of professional calls (usually in a set order) | examples=the doctor goes on his rounds first thing every morning; the postman's rounds
5. definition=the activity of playing 18 holes of golf | synonyms=round of golf | examples=a round of golf takes about 4 hours
6. definition=the usual activities in your day | synonyms=daily round | examples=the doctor made his rounds
7. definition=(sports) a division during which one team is on the offensive | synonyms=turn, bout
8. definition=the course along which communications spread | examples=the story is going the rounds in Washington
9. definition=a serving to each of a group (usually alcoholic) | synonyms=round of drinks | examples=he ordered a second round
10. definition=a cut of beef between the rump and the lower leg
11. definition=a partsong in which voices follow each other; one voice starts and others join in one after another until all are singing different parts of the song at the same time | synonyms=troll | examples=they enjoyed singing rounds
12. definition=an outburst of applause | examples=there was a round of applause
13. definition=a crosspiece between the legs of a chair | synonyms=rung, stave
14. definition=any circular or rotating mechanism | synonyms=circle | examples=the machine punched out metal circles

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a charge of ammunition for a single shot

    round%1:06:01:: · round.n.01

    Synonyms: unit of ammunition, one shot

  2. 2

    an interval during which a recurring sequence of events occurs

    round%1:28:01:: · cycle.n.01

    • the never-ending cycle of the seasons

    Synonyms: cycle, rhythm

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    a regular route for a sentry or policeman

    round%1:15:00:: · beat.n.01

    • in the old days a policeman walked a beat and knew all his people by name

    Synonyms: beat

  4. 4

    (often plural) a series of professional calls (usually in a set order)

    round%1:04:00:: · round.n.04

    • the doctor goes on his rounds first thing every morning
    • the postman's rounds
  5. 5

    the activity of playing 18 holes of golf

    round%1:04:03:: · round_of_golf.n.01

    • a round of golf takes about 4 hours

    Synonyms: round of golf

  6. 6

    the usual activities in your day

    round%1:04:01:: · round.n.06

    • the doctor made his rounds

    Synonyms: daily round

  7. 7

    (sports) a division during which one team is on the offensive

    round%1:28:00:: · turn.n.09

    Synonyms: turn, bout

    Selected
  8. 8

    the course along which communications spread

    round%1:17:00:: · round.n.08

    • the story is going the rounds in Washington
  9. 9

    a serving to each of a group (usually alcoholic)

    round%1:13:01:: · round.n.09

    • he ordered a second round

    Synonyms: round of drinks

  10. 10

    a cut of beef between the rump and the lower leg

    round%1:13:00:: · round.n.10

  11. 11

    a partsong in which voices follow each other; one voice starts and others join in one after another until all are singing different parts of the song at the same time

    round%1:10:00:: · round.n.11

    • they enjoyed singing rounds

    Synonyms: troll

  12. 12

    an outburst of applause

    round%1:10:01:: · round.n.12

    • there was a round of applause
  13. 13

    a crosspiece between the legs of a chair

    round%1:06:03:: · rung.n.01

    Synonyms: rung, stave

  14. 14

    any circular or rotating mechanism

    round%1:06:00:: · circle.n.08

    • the machine punched out metal circles

    Synonyms: circle

life Noun

Instance: semeval2013.d007.s005.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Arsenic-tolerant microbe raises possibility of new types of life on Earth, or elsewhere

The discovery of a strange bacteria that can use arsenic as one of its nutrients widens the scope for finding new forms of life on Earth and possibly beyond.

While researchers discovered the unusual bacteria here in Earth, they say it shows that life has possibilities beyond the major elements that have been considered essential.

"This organism has dual capability."

"It can grow with either phosphorus or arsenic."

"That makes it very peculiar, though it falls short of being some form of truly 'alien' life," commented Paul C. W. Davies of Arizona State University, a co-author of the report appearing in Thursday's online edition of the journal Science.

Six major elements have long been considered essential for life - carbon, hydrogen, nitrogen, oxygen, phosphorus and sulfur.

Show raw prompt

user

Which numbered sense of "life" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Arsenic-tolerant microbe raises possibility of new types of life on Earth, or elsewhere The discovery of a strange bacteria that can use arsenic as one of its nutrients widens the scope for finding new forms of life on Earth and possibly beyond. While researchers discovered the unusual bacteria here in Earth, they say it shows that life has possibilities beyond the major elements that have been considered essential. "This organism has dual capability." "It can grow with either phosphorus or arsenic." "That makes it very peculiar, though it falls short of being some form of truly 'alien' <t>life</t>," commented Paul C. W. Davies of Arizona State University, a co-author of the report appearing in Thursday's online edition of the journal Science. Six major elements have long been considered essential for life - carbon, hydrogen, nitrogen, oxygen, phosphorus and sulfur.

Senses:
1. definition=a characteristic state or mode of living | examples=social life; city life
2. definition=the experience of being alive; the course of human events and activities | synonyms=living | examples=he could no longer cope with the complexities of life
3. definition=the course of existence of an individual; the actions and events that occur in living | examples=he hoped for a new life in Australia; he wanted to live his own life without interference from others
4. definition=the condition of living or the state of being alive | synonyms=animation, living, aliveness | examples=while there's life there's hope; life depends on many chemical and physical processes
5. definition=the period during which something is functional (as between birth and death) | synonyms=lifetime, lifespan | examples=the battery had a short life; he lived a long and happy life
6. definition=the period between birth and the present time | examples=I have known him all his life
7. definition=the period from the present until death | examples=he appointed himself emperor for life
8. definition=a living person | examples=his heroism saved a life
9. definition=animation and energy in action or expression | synonyms=liveliness, spirit, sprightliness | examples=it was a heavy play and the actors tried in vain to give life to it
10. definition=living things collectively | examples=the oceans are teeming with life
11. definition=the organic phenomenon that distinguishes living organisms from nonliving ones | examples=there is no life on the moon
12. definition=an account of the series of events making up a person's life | synonyms=biography, life story, life history
13. definition=a motive for living | examples=pottery was his life
14. definition=a prison term lasting as long as the prisoner lives | synonyms=life sentence | examples=he got life for killing the guard

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a characteristic state or mode of living

    life%1:26:01:: · life.n.01

    • social life
    • city life
  2. 2

    the experience of being alive; the course of human events and activities

    life%1:09:00:: · life.n.02

    • he could no longer cope with the complexities of life

    Synonyms: living

  3. 3

    the course of existence of an individual; the actions and events that occur in living

    life%1:26:02:: · life.n.03

    • he hoped for a new life in Australia
    • he wanted to live his own life without interference from others
  4. 4

    the condition of living or the state of being alive

    life%1:26:00:: · animation.n.01

    • while there's life there's hope
    • life depends on many chemical and physical processes

    Synonyms: animation, living, aliveness

  5. 5

    the period during which something is functional (as between birth and death)

    life%1:28:00:: · life.n.05

    • the battery had a short life
    • he lived a long and happy life

    Synonyms: lifetime, lifespan

  6. 6

    the period between birth and the present time

    life%1:28:01:: · life.n.06

    • I have known him all his life
  7. 7

    the period from the present until death

    life%1:28:02:: · life.n.07

    • he appointed himself emperor for life
  8. 8

    a living person

    life%1:18:00:: · life.n.08

    • his heroism saved a life
  9. 9

    animation and energy in action or expression

    life%1:07:01:: · liveliness.n.02

    • it was a heavy play and the actors tried in vain to give life to it

    Synonyms: liveliness, spirit, sprightliness

  10. 10

    living things collectively

    life%1:03:00:: · life.n.10

    • the oceans are teeming with life
    Selected
  11. 11

    the organic phenomenon that distinguishes living organisms from nonliving ones

    life%1:19:00:: · life.n.11

    • there is no life on the moon
    Gold lexEN Gold Maru 2022 Gold Raganato
  12. 12

    an account of the series of events making up a person's life

    life%1:10:00:: · biography.n.01

    Synonyms: biography, life story, life history

  13. 13

    a motive for living

    life%1:16:00:: · life.n.13

    • pottery was his life
  14. 14

    a prison term lasting as long as the prisoner lives

    life%1:28:03:: · life_sentence.n.01

    • he got life for killing the guard

    Synonyms: life sentence

thing Noun

Instance: semeval2013.d008.s006.t000 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Support for democracy in Latin America continues to edge up, as does backing for private enterprise.

Crime has become a bigger worry than unemployment.

And Brazil is seen as more influential than the United States across much of the region.

Those are some of the findings of the latest Latinobarómetro poll taken in 18 countries and published exclusively by The Economist.

Because the poll has been taken regularly since 1995, it tracks changes in attitude across the region.

Two related things stand out in the results of this year's poll, taken in September and early October.

The first is Latin America's fairly sunny mood.

Show raw prompt

user

Which numbered sense of "thing" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Support for democracy in Latin America continues to edge up, as does backing for private enterprise. Crime has become a bigger worry than unemployment. And Brazil is seen as more influential than the United States across much of the region. Those are some of the findings of the latest Latinobarómetro poll taken in 18 countries and published exclusively by The Economist. Because the poll has been taken regularly since 1995, it tracks changes in attitude across the region. Two related <t>things</t> stand out in the results of this year's poll, taken in September and early October. The first is Latin America's fairly sunny mood.

Senses:
1. definition=a special situation | examples=this thing has got to end; it is a remarkable thing
2. definition=an action | examples=how could you do such a thing?
3. definition=a special abstraction | examples=a thing of the spirit; things of the heart
4. definition=an artifact | examples=how does this thing work?
5. definition=an event | examples=a funny thing happened on the way to the...
6. definition=a vaguely specified concern | synonyms=matter, affair | examples=several matters to attend to; it is none of your affair
7. definition=a statement regarded as an object | examples=to say the same thing in other terms; how can you say such a thing?
8. definition=an entity that is not named specifically | examples=I couldn't tell what the thing was
9. definition=any attribute or quality considered as having its own existence | examples=the thing I like about her is ...
10. definition=a special objective | examples=the thing is to stay in bounds
11. definition=a persistent illogical feeling of desire or aversion | examples=he has a thing about seafood; she has a thing about him
12. definition=a separate and self-contained entity

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    a special situation

    thing%1:26:00:: · thing.n.01

    • this thing has got to end
    • it is a remarkable thing
    Gold Raganato
  2. 2

    an action

    thing%1:04:00:: · thing.n.02

    • how could you do such a thing?
  3. 3

    a special abstraction

    thing%1:09:00:: · thing.n.03

    • a thing of the spirit
    • things of the heart
  4. 4

    an artifact

    thing%1:06:00:: · thing.n.04

    • how does this thing work?
  5. 5

    an event

    thing%1:11:00:: · thing.n.05

    • a funny thing happened on the way to the...
  6. 6

    a vaguely specified concern

    thing%1:09:02:: · matter.n.01

    • several matters to attend to
    • it is none of your affair

    Synonyms: matter, affair

    Gold lexEN
  7. 7

    a statement regarded as an object

    thing%1:10:00:: · thing.n.07

    • to say the same thing in other terms
    • how can you say such a thing?
  8. 8

    an entity that is not named specifically

    thing%1:06:01:: · thing.n.08

    • I couldn't tell what the thing was
    Selected
  9. 9

    any attribute or quality considered as having its own existence

    thing%1:07:00:: · thing.n.09

    • the thing I like about her is ...
  10. 10

    a special objective

    thing%1:09:01:: · thing.n.10

    • the thing is to stay in bounds
  11. 11

    a persistent illogical feeling of desire or aversion

    thing%1:12:00:: · thing.n.11

    • he has a thing about seafood
    • she has a thing about him
  12. 12

    a separate and self-contained entity

    thing%1:03:00:: · thing.n.12

    Gold Maru 2022

court Noun

Instance: semeval2013.d009.s000.t003 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Scalia and Thomas dine with healthcare law challengers as court takes case

The day the Supreme Court gathered behind closed doors to consider the politically divisive question of whether it would hear a challenge to President Obama's healthcare law, two of its justices, Antonin Scalia and Clarence Thomas, were feted at a dinner sponsored by the law firm that will argue the case before the high court.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Scalia and Thomas dine with healthcare law challengers as <t>court</t> takes case The day the Supreme Court gathered behind closed doors to consider the politically divisive question of whether it would hear a challenge to President Obama's healthcare law, two of its justices, Antonin Scalia and Clarence Thomas, were feted at a dinner sponsored by the law firm that will argue the case before the high court.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage

court Noun

Instance: semeval2013.d009.s005.t001 Dataset: semeval2013 Bucket: Candidate Count / 11+

Incorrect

Scalia and Thomas dine with healthcare law challengers as court takes case

The day the Supreme Court gathered behind closed doors to consider the politically divisive question of whether it would hear a challenge to President Obama's healthcare law, two of its justices, Antonin Scalia and Clarence Thomas, were feted at a dinner sponsored by the law firm that will argue the case before the high court.

The occasion was last Thursday, when all nine justices met for a conference to pour over the petitions for review.

One of the cases at issue was a suit brought by 26 states challenging the sweeping healthcare overhaul passed by Congress last year, a law that has been a rallying cry for conservative activists nationwide.

The justices agreed to hear the suit; indeed, a landmark 5.5 - hour argument is expected in March, and the outcome is likely to further roil the 2012 presidential race, which will be in full swing by the time the court's decision is released.

The lawyer who will stand before the court and argue that the law should be thrown out is likely to be Paul Clement, who served as U.S. solicitor general during the George W. Bush administration.

Clement's law firm, Bancroft PLLC, was one of almost two dozen firms that helped sponsor the annual dinner of the Federalist Society, a longstanding group dedicated to advocating conservative legal principles.

Show raw prompt

user

Which numbered sense of "court" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Scalia and Thomas dine with healthcare law challengers as court takes case The day the Supreme Court gathered behind closed doors to consider the politically divisive question of whether it would hear a challenge to President Obama's healthcare law, two of its justices, Antonin Scalia and Clarence Thomas, were feted at a dinner sponsored by the law firm that will argue the case before the high court. The occasion was last Thursday, when all nine justices met for a conference to pour over the petitions for review. One of the cases at issue was a suit brought by 26 states challenging the sweeping healthcare overhaul passed by Congress last year, a law that has been a rallying cry for conservative activists nationwide. The justices agreed to hear the suit; indeed, a landmark 5.5 - hour argument is expected in March, and the outcome is likely to further roil the 2012 presidential race, which will be in full swing by the time the court's decision is released. The lawyer who will stand before the <t>court</t> and argue that the law should be thrown out is likely to be Paul Clement, who served as U.S. solicitor general during the George W. Bush administration. Clement's law firm, Bancroft PLLC, was one of almost two dozen firms that helped sponsor the annual dinner of the Federalist Society, a longstanding group dedicated to advocating conservative legal principles.

Senses:
1. definition=an assembly (including one or more judges) to conduct judicial business | synonyms=tribunal, judicature
2. definition=a room in which a lawcourt sits | synonyms=courtroom | examples=television cameras were admitted in the courtroom
3. definition=the sovereign and his advisers who are the governing power of a state | synonyms=royal court
4. definition=a specially marked horizontal area within which a game is played | examples=players had to reserve a court in advance
5. definition=Australian woman tennis player who won many major championships (born in 1947) | synonyms=Margaret Court
6. definition=the family and retinue of a sovereign or prince | synonyms=royal court
7. definition=a hotel for motorists; provides direct access from rooms to parking area | synonyms=motor hotel, motor inn, motor lodge, tourist court
8. definition=a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws | synonyms=lawcourt, court of law, court of justice
9. definition=the residence of a sovereign or nobleman | examples=the king will visit the duke's court
10. definition=an area wholly or partly surrounded by walls or buildings | synonyms=courtyard | examples=the house was built around an inner court
11. definition=respectful deference | synonyms=homage | examples=pay court to the emperor

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    an assembly (including one or more judges) to conduct judicial business

    court%1:14:00:: · court.n.01

    Synonyms: tribunal, judicature

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    a room in which a lawcourt sits

    court%1:06:02:: · court.n.02

    • television cameras were admitted in the courtroom

    Synonyms: courtroom

  3. 3

    the sovereign and his advisers who are the governing power of a state

    court%1:14:01:: · court.n.03

    Synonyms: royal court

  4. 4

    a specially marked horizontal area within which a game is played

    court%1:06:01:: · court.n.04

    • players had to reserve a court in advance
  5. 5

    Australian woman tennis player who won many major championships (born in 1947)

    court%1:18:00:: · court.n.05

    Synonyms: Margaret Court

  6. 6

    the family and retinue of a sovereign or prince

    court%1:14:02:: · court.n.06

    Synonyms: royal court

  7. 7

    a hotel for motorists; provides direct access from rooms to parking area

    court%1:06:03:: · motor_hotel.n.01

    Synonyms: motor hotel, motor inn, motor lodge, tourist court

  8. 8

    a tribunal that is presided over by a magistrate or by one or more judges who administer justice according to the laws

    court%1:06:05:: · court.n.08

    Synonyms: lawcourt, court of law, court of justice

    Selected
  9. 9

    the residence of a sovereign or nobleman

    court%1:06:04:: · court.n.09

    • the king will visit the duke's court
  10. 10

    an area wholly or partly surrounded by walls or buildings

    court%1:06:00:: · court.n.10

    • the house was built around an inner court

    Synonyms: courtyard

  11. 11

    respectful deference

    court%1:04:00:: · court.n.11

    • pay court to the emperor

    Synonyms: homage