Verified run

gemini/gemini-2.5-flash

gemini-2.5-flash-p001-lexen-v1-20260614

Rank
69
Accuracy lexEN v1 · WordNet fine
89.41%
Correct
4346 / 4861
Actual run cost
$12.29
Cost / M items
$2,529

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 89.41% 4346 / 4861 96.48% 4690 / 4861 93.13% 4527 / 4861
Maru 2022 (ALLamended) 87.29% 4243 / 4861 95.87% 4660 / 4861 92.02% 4473 / 4861
Raganato 2017 (original) 81.36% 3955 / 4861 93.11% 4526 / 4861 87.90% 4273 / 4861

Model

Display
gemini/gemini-2.5-flash
Requested
gemini/gemini-2.5-flash
Resolved
gemini-2.5-flash
Vendor
Google
API provider
Google
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
n/a
Model URL
n/a
Endpoint
n/a
Resolved counts
gemini-2.5-flash: 4971

Reproducibility

Created
2026-06-14T11:03:39.454582+00:00
Run schema
sensebench-run-v2
Commit
2aac21b87b716ba75c3662d6630af4eca430f1b7
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p001
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4975
Total tokens
12,223,736
Tokens / item
2,514.7
Total cost
$12.29
Cost / M items
$2,529
Cost source
litellm_estimate
Elapsed
12.27m
Success items
4,856
Monosemous
0
No candidates
0
No valid vote
5
Invalid votes
1
Transport errors
4

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
2,048
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $12.29. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 3,203,244 $0.961 $0.300
Input cached 12,087 $0.000363 $0.0300
Output 4,533,437 $11.33 $2.50
Reasoning output 4,474,968 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 85.77% 681 794
Candidate Count 2 96.61% 826 855
Candidate Count 3-5 89.51% 1741 1945
Candidate Count 6-10 86.66% 1098 1267
POS ADJ 91.50% 603 659
POS ADV 88.72% 173 195
POS NOUN 90.44% 2620 2897
POS VERB 85.59% 950 1110
Source Dataset semeval2013 91.75% 1046 1140
Source Dataset semeval2015 90.80% 671 739
Source Dataset senseval2 87.66% 1428 1629
Source Dataset senseval3 88.77% 1201 1353

Worst-Bucket Examples

prevent Verb

Instance: semeval2015.d000.s017.t002 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

How is Alimta used?

Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy.

The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight).

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta.

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: prevent
Target surface form: prevent
Context:
How is Alimta used? Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy. The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight). It is given once every three weeks as an intravenous infusion lasting 10 minutes. To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta. When Alimta is given with cisplatin, an anti-emetic medicine (to <t>prevent</t> vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Candidate senses:
1. sense_key=prevent%2:41:01:: | definition=keep from happening or arising; make impossible | synonyms=forestall, foreclose, preclude, forbid | examples=My sense of tact forbids an honest answer; Your role in the projects precludes your involvement in the competitive project
2. sense_key=prevent%2:41:00:: | definition=stop (someone or something) from doing something or being in a certain state | synonyms=keep | examples=We must prevent the cancer from spreading; His snoring kept me from falling asleep

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    keep from happening or arising; make impossible

    prevent%2:41:01:: · prevent.v.01

    • My sense of tact forbids an honest answer
    • Your role in the projects precludes your involvement in the competitive project

    Synonyms: forestall, foreclose, preclude, forbid

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    stop (someone or something) from doing something or being in a certain state

    prevent%2:41:00:: · prevent.v.02

    • We must prevent the cancer from spreading
    • His snoring kept me from falling asleep

    Synonyms: keep

    Gold Raganato Selected

convert Verb

Instance: semeval2015.d000.s023.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: convert
Target surface form: converted
Context:
Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is <t>converted</t> into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied?

Candidate senses:
1. sense_key=convert%2:30:00:: | definition=change from one system to another or to a new plan or policy | synonyms=change over | examples=We converted from 220 to 110 Volt
2. sense_key=convert%2:30:03:: | definition=change the nature, purpose, or function of something | examples=convert lead into gold; convert hotels into jails
3. sense_key=convert%2:30:01:: | definition=change religious beliefs, or adopt a religious belief | examples=She converted to Buddhism
4. sense_key=convert%2:30:02:: | definition=exchange or replace with another, usually of the same kind or category | synonyms=change, exchange, commute | examples=Could you convert my dollars into pounds?; He changed his name
5. sense_key=convert%2:30:07:: | definition=cause to adopt a new or different faith | examples=The missionaries converted the Indian population
6. sense_key=convert%2:33:02:: | definition=score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone | examples=Smith converted and his team won
7. sense_key=convert%2:33:01:: | definition=complete successfully | examples=score a penalty shot or free throw
8. sense_key=convert%2:33:00:: | definition=score (a spare)
9. sense_key=convert%2:32:00:: | definition=make (someone) agree, understand, or realize the truth or validity of something | synonyms=win over, convince | examples=He had finally convinced several customers of the advantages of his product
10. sense_key=convert%2:30:09:: | definition=exchange a penalty for a less severe one | synonyms=commute, exchange
11. sense_key=convert%2:30:04:: | definition=change in nature, purpose, or function; undergo a chemical change | examples=The substance converts to an acid

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    change from one system to another or to a new plan or policy

    convert%2:30:00:: · convert.v.01

    • We converted from 220 to 110 Volt

    Synonyms: change over

  2. 2

    change the nature, purpose, or function of something

    convert%2:30:03:: · convert.v.02

    • convert lead into gold
    • convert hotels into jails
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    change religious beliefs, or adopt a religious belief

    convert%2:30:01:: · convert.v.03

    • She converted to Buddhism
  4. 4

    exchange or replace with another, usually of the same kind or category

    convert%2:30:02:: · change.v.06

    • Could you convert my dollars into pounds?
    • He changed his name

    Synonyms: change, exchange, commute

  5. 5

    cause to adopt a new or different faith

    convert%2:30:07:: · convert.v.05

    • The missionaries converted the Indian population
  6. 6

    score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone

    convert%2:33:02:: · convert.v.06

    • Smith converted and his team won
  7. 7

    complete successfully

    convert%2:33:01:: · convert.v.07

    • score a penalty shot or free throw
  8. 8

    score (a spare)

    convert%2:33:00:: · convert.v.08

  9. 9

    make (someone) agree, understand, or realize the truth or validity of something

    convert%2:32:00:: · convert.v.09

    • He had finally convinced several customers of the advantages of his product

    Synonyms: win over, convince

  10. 10

    exchange a penalty for a less severe one

    convert%2:30:09:: · commute.v.04

    Synonyms: commute, exchange

  11. 11

    change in nature, purpose, or function; undergo a chemical change

    convert%2:30:04:: · convert.v.11

    • The substance converts to an acid
    Gold Raganato Selected

involve Verb

Instance: semeval2015.d000.s028.t006 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before.

The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone.

For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

In all three studies, the main measure of effectiveness was how long the patients survived.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: involve
Target surface form: involving
Context:
In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied? For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before. The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone. For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past. Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study <t>involving</t> 1,725 patients who had not received chemotherapy for lung cancer in the past. In all three studies, the main measure of effectiveness was how long the patients survived.

Candidate senses:
1. sense_key=involve%2:42:01:: | definition=connect closely and often incriminatingly | synonyms=affect, regard | examples=This new ruling affects your business
2. sense_key=involve%2:42:04:: | definition=engage as a participant | examples=Don't involve me in your family affairs!
3. sense_key=involve%2:42:00:: | definition=have as a necessary feature | synonyms=imply | examples=This decision involves many changes
4. sense_key=involve%2:42:07:: | definition=require as useful, just, or proper | synonyms=necessitate, ask, postulate, need, require, take | examples=It takes nerve to do what she did; success usually requires hard work
5. sense_key=involve%2:42:02:: | definition=contain as a part | examples=Dinner at Joe's always involves at least six courses
6. sense_key=involve%2:31:00:: | definition=occupy or engage the interest of | examples=His story completely involved me during the entire afternoon
7. sense_key=involve%2:30:00:: | definition=make complex or intricate or complicated | examples=The situation was rather involved

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    connect closely and often incriminatingly

    involve%2:42:01:: · involve.v.01

    • This new ruling affects your business

    Synonyms: affect, regard

  2. 2

    engage as a participant

    involve%2:42:04:: · involve.v.02

    • Don't involve me in your family affairs!
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    have as a necessary feature

    involve%2:42:00:: · imply.v.05

    • This decision involves many changes

    Synonyms: imply

  4. 4

    require as useful, just, or proper

    involve%2:42:07:: · necessitate.v.01

    • It takes nerve to do what she did
    • success usually requires hard work

    Synonyms: necessitate, ask, postulate, need, require, take, call for, demand

  5. 5

    contain as a part

    involve%2:42:02:: · involve.v.05

    • Dinner at Joe's always involves at least six courses
    Selected
  6. 6

    occupy or engage the interest of

    involve%2:31:00:: · involve.v.06

    • His story completely involved me during the entire afternoon
  7. 7

    make complex or intricate or complicated

    involve%2:30:00:: · involve.v.07

    • The situation was rather involved

show Verb

Instance: semeval2015.d000.s030.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before.

The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone.

For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

In all three studies, the main measure of effectiveness was how long the patients survived.

What benefit has Alimta shown during the studies?

Alimta increased the survival time of patients with malignant pleural mesothelioma.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: show
Target surface form: shown
Context:
For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before. The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone. For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past. Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past. In all three studies, the main measure of effectiveness was how long the patients survived. What benefit has Alimta <t>shown</t> during the studies? Alimta increased the survival time of patients with malignant pleural mesothelioma.

Candidate senses:
1. sense_key=show%2:39:02:: | definition=give an exhibition of to an interested audience | synonyms=demo, exhibit, present, demonstrate | examples=She shows her dogs frequently; We will demo the new software in Washington
2. sense_key=show%2:31:00:: | definition=establish the validity of something, as by an example, explanation or experiment | synonyms=prove, demonstrate, establish, shew | examples=The experiment demonstrated the instability of the compound; The mathematician showed the validity of the conjecture
3. sense_key=show%2:32:00:: | definition=provide evidence for | synonyms=testify, bear witness, prove, evidence | examples=The blood test showed that he was the father; Her behavior testified to her incompetence
4. sense_key=show%2:39:00:: | definition=make visible or noticeable | examples=She showed her talent for cooking; Show me your etchings, please
5. sense_key=show%2:36:00:: | definition=show in, or as in, a picture | synonyms=picture, depict, render | examples=This scene depicts country life; the face of the child is rendered with much tenderness in this painting
6. sense_key=show%2:32:02:: | definition=give expression to | synonyms=express, evince | examples=She showed her disappointment
7. sense_key=show%2:32:01:: | definition=indicate a place, direction, person, or thing; either spatially or figuratively | synonyms=indicate, point, designate | examples=I showed the customer the glove section; He pointed to the empty parking space
8. sense_key=show%2:39:01:: | definition=be or become visible or noticeable | synonyms=show up | examples=His good upbringing really shows; The dirty side will show
9. sense_key=show%2:32:04:: | definition=indicate a certain reading; of gauges and instruments | synonyms=read, register, record | examples=The thermometer showed thirteen degrees below zero; The gauge read `empty'
10. sense_key=show%2:32:03:: | definition=give evidence of, as of records | examples=The diary shows his distress that evening
11. sense_key=show%2:38:00:: | definition=take (someone) to their seats, as in theaters or auditoriums | synonyms=usher | examples=The usher showed us to our seats
12. sense_key=show%2:33:00:: | definition=finish third or better in a horse or dog race | examples=he bet $2 on number six to show

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    give an exhibition of to an interested audience

    show%2:39:02:: · show.v.01

    • She shows her dogs frequently
    • We will demo the new software in Washington

    Synonyms: demo, exhibit, present, demonstrate

  2. 2

    establish the validity of something, as by an example, explanation or experiment

    show%2:31:00:: · prove.v.02

    • The experiment demonstrated the instability of the compound
    • The mathematician showed the validity of the conjecture

    Synonyms: prove, demonstrate, establish, shew

    Gold Raganato Selected
  3. 3

    provide evidence for

    show%2:32:00:: · testify.v.02

    • The blood test showed that he was the father
    • Her behavior testified to her incompetence

    Synonyms: testify, bear witness, prove, evidence

    Gold lexEN Gold Maru 2022
  4. 4

    make visible or noticeable

    show%2:39:00:: · show.v.04

    • She showed her talent for cooking
    • Show me your etchings, please
    Gold lexEN Gold Maru 2022
  5. 5

    show in, or as in, a picture

    show%2:36:00:: · picture.v.02

    • This scene depicts country life
    • the face of the child is rendered with much tenderness in this painting

    Synonyms: picture, depict, render

    Gold Raganato
  6. 6

    give expression to

    show%2:32:02:: · express.v.01

    • She showed her disappointment

    Synonyms: express, evince

  7. 7

    indicate a place, direction, person, or thing; either spatially or figuratively

    show%2:32:01:: · indicate.v.02

    • I showed the customer the glove section
    • He pointed to the empty parking space

    Synonyms: indicate, point, designate

  8. 8

    be or become visible or noticeable

    show%2:39:01:: · show.v.08

    • His good upbringing really shows
    • The dirty side will show

    Synonyms: show up

  9. 9

    indicate a certain reading; of gauges and instruments

    show%2:32:04:: · read.v.08

    • The thermometer showed thirteen degrees below zero
    • The gauge read `empty'

    Synonyms: read, register, record

  10. 10

    give evidence of, as of records

    show%2:32:03:: · show.v.10

    • The diary shows his distress that evening
  11. 11

    take (someone) to their seats, as in theaters or auditoriums

    show%2:38:00:: · usher.v.01

    • The usher showed us to our seats

    Synonyms: usher

  12. 12

    finish third or better in a horse or dog race

    show%2:33:00:: · show.v.12

    • he bet $2 on number six to show

consist Verb

Instance: semeval2015.d001.s007.t002 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

It is actually not necessary to know MathML to use kalgebra.

kalgebra is a MathML based graph calculator.

Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge.

Here's a screenshot of kalgebra main window

kalgebra main window

kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab.

Below these tabs you will find an input field to type your functions or do your calculations.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: consist
Target surface form: consists
Context:
It is actually not necessary to know MathML to use kalgebra. kalgebra is a MathML based graph calculator. Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge. Here's a screenshot of kalgebra main window kalgebra main window kalgebra main window <t>consists</t> in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab. Below these tabs you will find an input field to type your functions or do your calculations.

Candidate senses:
1. sense_key=consist%2:42:00:: | definition=originate (in) | synonyms=dwell, lie, lie in | examples=The problems dwell in the social injustices in this country
2. sense_key=consist%2:42:04:: | definition=have its essential character; be comprised or contained in; be embodied in | examples=The payment consists in food; What does love consist in?
3. sense_key=consist%2:42:02:: | definition=be consistent in form, tenor, or character; be congruous | examples=Desires are to be satisfied only so far as consists with an approved end
4. sense_key=consist%2:42:01:: | definition=be composed of | synonyms=comprise | examples=The land he conquered comprised several provinces; What does this dish consist of?

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    originate (in)

    consist%2:42:00:: · dwell.v.02

    • The problems dwell in the social injustices in this country

    Synonyms: dwell, lie, lie in

  2. 2

    have its essential character; be comprised or contained in; be embodied in

    consist%2:42:04:: · consist.v.02

    • The payment consists in food
    • What does love consist in?
    Selected
  3. 3

    be consistent in form, tenor, or character; be congruous

    consist%2:42:02:: · consist.v.03

    • Desires are to be satisfied only so far as consists with an approved end
  4. 4

    be composed of

    consist%2:42:01:: · consist.v.04

    • The land he conquered comprised several provinces
    • What does this dish consist of?

    Synonyms: comprise

    Gold lexEN Gold Maru 2022 Gold Raganato

find Verb

Instance: semeval2015.d001.s008.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

kalgebra is a MathML based graph calculator.

Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge.

Here's a screenshot of kalgebra main window

kalgebra main window

kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab.

Below these tabs you will find an input field to type your functions or do your calculations.

If we want to understand how it works, the best thing we can do is to realize that our input is being converted into MathML although it is not necessary to know MathML.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: find
Target surface form: find
Context:
kalgebra is a MathML based graph calculator. Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge. Here's a screenshot of kalgebra main window kalgebra main window kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab. Below these tabs you will <t>find</t> an input field to type your functions or do your calculations. If we want to understand how it works, the best thing we can do is to realize that our input is being converted into MathML although it is not necessary to know MathML.

Candidate senses:
1. sense_key=find%2:40:02:: | definition=come upon, as if by accident; meet with | synonyms=happen, chance, bump, encounter | examples=We find this idea in Plato; I happened upon the most wonderful bakery not very far from here
2. sense_key=find%2:39:02:: | definition=discover or determine the existence, presence, or fact of | synonyms=detect, observe, discover, notice | examples=She detected high levels of lead in her drinking water; We found traces of lead in the paint
3. sense_key=find%2:40:00:: | definition=come upon after searching; find the location of something that was missed or lost | synonyms=regain | examples=Did you find your glasses?; I cannot find my gloves!
4. sense_key=find%2:32:00:: | definition=establish after a calculation, investigation, experiment, survey, or study | synonyms=determine, find out, ascertain | examples=find the product of two numbers; The physicist who found the elusive particle won the Nobel Prize
5. sense_key=find%2:31:10:: | definition=come to believe on the basis of emotion, intuitions, or indefinite grounds | synonyms=feel | examples=I feel that he doesn't like me; I find him to be obnoxious
6. sense_key=find%2:39:01:: | definition=perceive or be contemporaneous with | synonyms=witness, see | examples=We found Republicans winning the offices; You'll see a lot of cheating in this school
7. sense_key=find%2:40:01:: | definition=get something or somebody for a specific purpose | synonyms=line up, get hold, come up | examples=I found this gadget that will serve as a bottle opener; I got hold of these tools to fix our plumbing
8. sense_key=find%2:36:00:: | definition=make a discovery, make a new finding | synonyms=discover | examples=Roentgen discovered X-rays; Physicists believe they found a new elementary particle
9. sense_key=find%2:31:09:: | definition=make a discovery | synonyms=discover | examples=She found that he had lied to her; The story is false, so far as I can discover
10. sense_key=find%2:40:03:: | definition=obtain through effort or management | examples=She found the time and energy to take care of her aging parents; We found the money to send our sons to college
11. sense_key=find%2:32:01:: | definition=decide on and make a declaration about | synonyms=rule | examples=find someone guilty
12. sense_key=find%2:30:00:: | definition=receive a specified treatment (abstract) | synonyms=receive, get, obtain, incur | examples=These aspects of civilization do not find expression or receive an interpretation; His movie received a good review
13. sense_key=find%2:39:05:: | definition=perceive oneself to be in a certain condition or place | examples=I found myself in a difficult situation; When he woke up, he found himself in a hospital room
14. sense_key=find%2:40:15:: | definition=get or find back; recover the use of | synonyms=recover, retrieve, regain | examples=She regained control of herself; She found her voice and replied quickly
15. sense_key=find%2:38:10:: | definition=succeed in reaching; arrive at | examples=The arrow found its mark
16. sense_key=find%2:30:13:: | definition=accept and make use of one's personality, abilities, and situation | synonyms=find oneself | examples=My son went to Berkeley to find himself

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    come upon, as if by accident; meet with

    find%2:40:02:: · find.v.01

    • We find this idea in Plato
    • I happened upon the most wonderful bakery not very far from here

    Synonyms: happen, chance, bump, encounter

  2. 2

    discover or determine the existence, presence, or fact of

    find%2:39:02:: · detect.v.01

    • She detected high levels of lead in her drinking water
    • We found traces of lead in the paint

    Synonyms: detect, observe, discover, notice

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    come upon after searching; find the location of something that was missed or lost

    find%2:40:00:: · find.v.03

    • Did you find your glasses?
    • I cannot find my gloves!

    Synonyms: regain

  4. 4

    establish after a calculation, investigation, experiment, survey, or study

    find%2:32:00:: · determine.v.01

    • find the product of two numbers
    • The physicist who found the elusive particle won the Nobel Prize

    Synonyms: determine, find out, ascertain

  5. 5

    come to believe on the basis of emotion, intuitions, or indefinite grounds

    find%2:31:10:: · find.v.05

    • I feel that he doesn't like me
    • I find him to be obnoxious

    Synonyms: feel

  6. 6

    perceive or be contemporaneous with

    find%2:39:01:: · witness.v.02

    • We found Republicans winning the offices
    • You'll see a lot of cheating in this school

    Synonyms: witness, see

    Selected
  7. 7

    get something or somebody for a specific purpose

    find%2:40:01:: · line_up.v.02

    • I found this gadget that will serve as a bottle opener
    • I got hold of these tools to fix our plumbing

    Synonyms: line up, get hold, come up

  8. 8

    make a discovery, make a new finding

    find%2:36:00:: · discover.v.03

    • Roentgen discovered X-rays
    • Physicists believe they found a new elementary particle

    Synonyms: discover

  9. 9

    make a discovery

    find%2:31:09:: · discover.v.04

    • She found that he had lied to her
    • The story is false, so far as I can discover

    Synonyms: discover

  10. 10

    obtain through effort or management

    find%2:40:03:: · find.v.10

    • She found the time and energy to take care of her aging parents
    • We found the money to send our sons to college
  11. 11

    decide on and make a declaration about

    find%2:32:01:: · rule.v.04

    • find someone guilty

    Synonyms: rule

  12. 12

    receive a specified treatment (abstract)

    find%2:30:00:: · receive.v.02

    • These aspects of civilization do not find expression or receive an interpretation
    • His movie received a good review

    Synonyms: receive, get, obtain, incur

  13. 13

    perceive oneself to be in a certain condition or place

    find%2:39:05:: · find.v.13

    • I found myself in a difficult situation
    • When he woke up, he found himself in a hospital room
  14. 14

    get or find back; recover the use of

    find%2:40:15:: · recover.v.01

    • She regained control of herself
    • She found her voice and replied quickly

    Synonyms: recover, retrieve, regain

  15. 15

    succeed in reaching; arrive at

    find%2:38:10:: · find.v.15

    • The arrow found its mark
  16. 16

    accept and make use of one's personality, abilities, and situation

    find%2:30:13:: · find_oneself.v.01

    • My son went to Berkeley to find himself

    Synonyms: find oneself

realize Verb

Instance: semeval2015.d001.s009.t006 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge.

Here's a screenshot of kalgebra main window

kalgebra main window

kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab.

Below these tabs you will find an input field to type your functions or do your calculations.

If we want to understand how it works, the best thing we can do is to realize that our input is being converted into MathML although it is not necessary to know MathML.

I have based the syntax basically on common sense, it should not be hard for anyone.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: realize
Target surface form: realize
Context:
Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge. Here's a screenshot of kalgebra main window kalgebra main window kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab. Below these tabs you will find an input field to type your functions or do your calculations. If we want to understand how it works, the best thing we can do is to <t>realize</t> that our input is being converted into MathML although it is not necessary to know MathML. I have based the syntax basically on common sense, it should not be hard for anyone.

Candidate senses:
1. sense_key=realize%2:31:01:: | definition=be fully aware or cognizant of | synonyms=recognize, recognise, realise, agnize, agnise
2. sense_key=realize%2:31:00:: | definition=perceive (an idea or situation) mentally | synonyms=understand, realise, see | examples=Now I see!; I just can't see your point
3. sense_key=realize%2:36:00:: | definition=make real or concrete; give reality or substance to | synonyms=realise, actualize, actualise, substantiate | examples=our ideas must be substantiated into actions
4. sense_key=realize%2:40:01:: | definition=earn on some commercial or business transaction; earn as salary or wages | synonyms=gain, take in, clear, make, earn, realise | examples=How much do you make a month in your new job?; She earns a lot in her new job
5. sense_key=realize%2:40:00:: | definition=convert into cash; of goods and property | synonyms=realise
6. sense_key=realize%2:36:07:: | definition=expand or complete (a part in a piece of baroque music) by supplying the harmonies indicated in the figured bass | synonyms=realise

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    be fully aware or cognizant of

    realize%2:31:01:: · recognize.v.02

    Synonyms: recognize, recognise, realise, agnize, agnise

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    perceive (an idea or situation) mentally

    realize%2:31:00:: · understand.v.02

    • Now I see!
    • I just can't see your point

    Synonyms: understand, realise, see

    Gold Raganato Selected
  3. 3

    make real or concrete; give reality or substance to

    realize%2:36:00:: · realize.v.03

    • our ideas must be substantiated into actions

    Synonyms: realise, actualize, actualise, substantiate

  4. 4

    earn on some commercial or business transaction; earn as salary or wages

    realize%2:40:01:: · gain.v.08

    • How much do you make a month in your new job?
    • She earns a lot in her new job

    Synonyms: gain, take in, clear, make, earn, realise, pull in, bring in

  5. 5

    convert into cash; of goods and property

    realize%2:40:00:: · realize.v.05

    Synonyms: realise

  6. 6

    expand or complete (a part in a piece of baroque music) by supplying the harmonies indicated in the figured bass

    realize%2:36:07:: · realize.v.06

    Synonyms: realise

use Verb

Instance: semeval2015.d001.s023.t002 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

abc(params): When the parser finds a function, it checks if abc is an operator.

If it is, it will be treated as an operator, if it is not, it will be treated as a user function.

: =: It is used to define a variable value.

?: Piecewise condition definition.

Piecewise is the way we can define conditional operations in kalgebra.

If we introduce the condition before the? it will use this condition only if it is true, if it finds a? without any condition, it will enter in the last instance.

{}: MathML container.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: use
Target surface form: use
Context:
abc(params): When the parser finds a function, it checks if abc is an operator. If it is, it will be treated as an operator, if it is not, it will be treated as a user function.: =: It is used to define a variable value.?: Piecewise condition definition. Piecewise is the way we can define conditional operations in kalgebra. If we introduce the condition before the? it will <t>use</t> this condition only if it is true, if it finds a? without any condition, it will enter in the last instance. {}: MathML container.

Candidate senses:
1. sense_key=use%2:34:01:: | definition=put into service; make work or employ for a particular purpose or for its inherent or natural purpose | synonyms=utilize, utilise, apply, employ | examples=use your head!; we only use Spanish at home
2. sense_key=use%2:34:02:: | definition=take or consume (regularly or habitually) | synonyms=habituate | examples=She uses drugs rarely
3. sense_key=use%2:34:00:: | definition=use up, consume fully | synonyms=expend | examples=The legislature expended its time on school questions
4. sense_key=use%2:41:14:: | definition=seek or achieve an end by using to one's advantage | examples=She uses her influential friends to get jobs; The president's wife used her good connections
5. sense_key=use%2:41:04:: | definition=avail oneself to | synonyms=practice, apply | examples=apply a principle; practice a religion
6. sense_key=use%2:41:03:: | definition=habitually do something (use only in the past tense) | examples=She used to call her mother every week but now she calls only occasionally; I used to get sick when I ate in that dining hall

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    put into service; make work or employ for a particular purpose or for its inherent or natural purpose

    use%2:34:01:: · use.v.01

    • use your head!
    • we only use Spanish at home

    Synonyms: utilize, utilise, apply, employ

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    take or consume (regularly or habitually)

    use%2:34:02:: · use.v.02

    • She uses drugs rarely

    Synonyms: habituate

  3. 3

    use up, consume fully

    use%2:34:00:: · use.v.03

    • The legislature expended its time on school questions

    Synonyms: expend

  4. 4

    seek or achieve an end by using to one's advantage

    use%2:41:14:: · use.v.04

    • She uses her influential friends to get jobs
    • The president's wife used her good connections
  5. 5

    avail oneself to

    use%2:41:04:: · practice.v.04

    • apply a principle
    • practice a religion

    Synonyms: practice, apply

    Selected
  6. 6

    habitually do something (use only in the past tense)

    use%2:41:03:: · use.v.06

    • She used to call her mother every week but now she calls only occasionally
    • I used to get sick when I ate in that dining hall

work Verb

Instance: semeval2015.d001.s026.t002 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

?: Piecewise condition definition.

Piecewise is the way we can define conditional operations in kalgebra.

If we introduce the condition before the? it will use this condition only if it is true, if it finds a? without any condition, it will enter in the last instance.

{}: MathML container.

It can be used to define a container.

Mainly useful for working with piecewise.

Now you could ask me, why should the user mind about MathML?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: work
Target surface form: working
Context:
?: Piecewise condition definition. Piecewise is the way we can define conditional operations in kalgebra. If we introduce the condition before the? it will use this condition only if it is true, if it finds a? without any condition, it will enter in the last instance. {}: MathML container. It can be used to define a container. Mainly useful for <t>working</t> with piecewise. Now you could ask me, why should the user mind about MathML?

Candidate senses:
1. sense_key=work%2:41:02:: | definition=exert oneself by doing mental or physical work for a purpose or out of necessity | examples=I will work hard to improve my grades; she worked hard for better living conditions for the poor
2. sense_key=work%2:41:00:: | definition=be employed | synonyms=do work | examples=Is your husband working again?; My wife never worked
3. sense_key=work%2:41:03:: | definition=have an effect or outcome; often the one desired or expected | synonyms=act | examples=The voting process doesn't work as well as people thought; How does your idea work in practice?
4. sense_key=work%2:35:02:: | definition=perform as expected when applied | synonyms=function, operate, go, run | examples=The washing machine won't go unless it's plugged in; Does this old car still run well?
5. sense_key=work%2:36:00:: | definition=shape, form, or improve a material | synonyms=work on, process | examples=work stone into tools; process iron
6. sense_key=work%2:29:00:: | definition=give a workout to | synonyms=exercise, work out | examples=Some parents exercise their infants; My personal trainer works me hard
7. sense_key=work%2:38:00:: | definition=proceed along a path | synonyms=make | examples=work one's way through the crowd; make one's way into the forest
8. sense_key=work%2:41:04:: | definition=operate in a certain place, area, or specialty | examples=She works the night clubs; The salesman works the Midwest
9. sense_key=work%2:41:05:: | definition=proceed towards a goal or along a path or through an activity | examples=work your way through every problem or task; She was working on her second martini when the guests arrived
10. sense_key=work%2:38:02:: | definition=move in an agitated manner | examples=His fingers worked with tension
11. sense_key=work%2:36:01:: | definition=cause to happen or to occur as a consequence | synonyms=bring, play, wreak, make for | examples=I cannot work a miracle; wreak havoc
12. sense_key=work%2:41:01:: | definition=cause to work | synonyms=put to work | examples=he is working his servants hard
13. sense_key=work%2:36:09:: | definition=prepare for crops | synonyms=cultivate, crop | examples=Work the soil; cultivate the land
14. sense_key=work%2:42:10:: | definition=behave in a certain way when handled | examples=This dough does not work easily; The soft metal works well
15. sense_key=work%2:41:10:: | definition=have and exert influence or effect | synonyms=influence, act upon | examples=The artist's work influenced the young painter; She worked on her friends to support the political candidate
16. sense_key=work%2:41:11:: | definition=operate in or through | examples=Work the phones
17. sense_key=work%2:41:12:: | definition=cause to operate or function | examples=This pilot works the controls; Can you work an electric drill?
18. sense_key=work%2:39:10:: | definition=provoke or excite | examples=The rock musician worked the crowd of young girls into a frenzy
19. sense_key=work%2:37:10:: | definition=gratify and charm, usually in order to influence | examples=the political candidate worked the crowds
20. sense_key=work%2:36:12:: | definition=make something, usually for a specific function | synonyms=shape, form, mold, mould, forge | examples=She molded the rice balls carefully; Form cylinders from the dough
21. sense_key=work%2:35:14:: | definition=move into or onto | examples=work the raisins into the dough; the student worked a few jokes into his presentation
22. sense_key=work%2:35:00:: | definition=make uniform | synonyms=knead | examples=knead dough; work the clay until it is soft
23. sense_key=work%2:34:10:: | definition=use or manipulate to one's advantage | synonyms=exploit | examples=He exploit the new taxation system; She knows how to work the system
24. sense_key=work%2:31:13:: | definition=find the solution to (a problem or question) or understand the meaning of | synonyms=solve, work out, figure out, puzzle out, lick | examples=did you solve the problem?; Work out your problems with the boss
25. sense_key=work%2:30:14:: | definition=cause to undergo fermentation | synonyms=ferment | examples=We ferment the grapes for a very long time to achieve high alcohol content; The vintner worked the wine in big oak vats
26. sense_key=work%2:30:13:: | definition=go sour or spoil | synonyms=sour, turn, ferment | examples=The milk has soured; The wine worked
27. sense_key=work%2:30:10:: | definition=arrive at a certain condition through repeated motion | examples=The stitches of the hem worked loose after she wore the skirt many times

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    exert oneself by doing mental or physical work for a purpose or out of necessity

    work%2:41:02:: · work.v.01

    • I will work hard to improve my grades
    • she worked hard for better living conditions for the poor
    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    be employed

    work%2:41:00:: · work.v.02

    • Is your husband working again?
    • My wife never worked

    Synonyms: do work

  3. 3

    have an effect or outcome; often the one desired or expected

    work%2:41:03:: · work.v.03

    • The voting process doesn't work as well as people thought
    • How does your idea work in practice?

    Synonyms: act

  4. 4

    perform as expected when applied

    work%2:35:02:: · function.v.01

    • The washing machine won't go unless it's plugged in
    • Does this old car still run well?

    Synonyms: function, operate, go, run

  5. 5

    shape, form, or improve a material

    work%2:36:00:: · work.v.05

    • work stone into tools
    • process iron

    Synonyms: work on, process

  6. 6

    give a workout to

    work%2:29:00:: · exercise.v.03

    • Some parents exercise their infants
    • My personal trainer works me hard

    Synonyms: exercise, work out

  7. 7

    proceed along a path

    work%2:38:00:: · make.v.36

    • work one's way through the crowd
    • make one's way into the forest

    Synonyms: make

  8. 8

    operate in a certain place, area, or specialty

    work%2:41:04:: · work.v.08

    • She works the night clubs
    • The salesman works the Midwest
  9. 9

    proceed towards a goal or along a path or through an activity

    work%2:41:05:: · work.v.09

    • work your way through every problem or task
    • She was working on her second martini when the guests arrived
    Selected
  10. 10

    move in an agitated manner

    work%2:38:02:: · work.v.10

    • His fingers worked with tension
  11. 11

    cause to happen or to occur as a consequence

    work%2:36:01:: · bring.v.03

    • I cannot work a miracle
    • wreak havoc

    Synonyms: bring, play, wreak, make for

  12. 12

    cause to work

    work%2:41:01:: · work.v.12

    • he is working his servants hard

    Synonyms: put to work

  13. 13

    prepare for crops

    work%2:36:09:: · cultivate.v.02

    • Work the soil
    • cultivate the land

    Synonyms: cultivate, crop

  14. 14

    behave in a certain way when handled

    work%2:42:10:: · work.v.14

    • This dough does not work easily
    • The soft metal works well
  15. 15

    have and exert influence or effect

    work%2:41:10:: · influence.v.01

    • The artist's work influenced the young painter
    • She worked on her friends to support the political candidate

    Synonyms: influence, act upon

  16. 16

    operate in or through

    work%2:41:11:: · work.v.16

    • Work the phones
  17. 17

    cause to operate or function

    work%2:41:12:: · work.v.17

    • This pilot works the controls
    • Can you work an electric drill?
  18. 18

    provoke or excite

    work%2:39:10:: · work.v.18

    • The rock musician worked the crowd of young girls into a frenzy
  19. 19

    gratify and charm, usually in order to influence

    work%2:37:10:: · work.v.19

    • the political candidate worked the crowds
  20. 20

    make something, usually for a specific function

    work%2:36:12:: · shape.v.02

    • She molded the rice balls carefully
    • Form cylinders from the dough

    Synonyms: shape, form, mold, mould, forge

  21. 21

    move into or onto

    work%2:35:14:: · work.v.21

    • work the raisins into the dough
    • the student worked a few jokes into his presentation
  22. 22

    make uniform

    work%2:35:00:: · knead.v.01

    • knead dough
    • work the clay until it is soft

    Synonyms: knead

  23. 23

    use or manipulate to one's advantage

    work%2:34:10:: · exploit.v.01

    • He exploit the new taxation system
    • She knows how to work the system

    Synonyms: exploit

  24. 24

    find the solution to (a problem or question) or understand the meaning of

    work%2:31:13:: · solve.v.01

    • did you solve the problem?
    • Work out your problems with the boss

    Synonyms: solve, work out, figure out, puzzle out, lick

  25. 25

    cause to undergo fermentation

    work%2:30:14:: · ferment.v.03

    • We ferment the grapes for a very long time to achieve high alcohol content
    • The vintner worked the wine in big oak vats

    Synonyms: ferment

  26. 26

    go sour or spoil

    work%2:30:13:: · sour.v.01

    • The milk has soured
    • The wine worked

    Synonyms: sour, turn, ferment

  27. 27

    arrive at a certain condition through repeated motion

    work%2:30:10:: · work.v.27

    • The stitches of the hem worked loose after she wore the skirt many times

have Verb

Instance: semeval2015.d001.s032.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Now you could ask me, why should the user mind about MathML?

That s easy. With this, we can operate with functions like cos(), sin(), any other trigonometric functions, sum () or product ().

It does not matter what kind it is.

We can use plus(), times() and everything which has its operator.

kalgebra's console is useful as a calculator.

There you have a list of the declared variables.

By double clicking on them you will see a dialog that lets you change their values (just a way to trick the log).

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: have
Target surface form: have
Context:
Now you could ask me, why should the user mind about MathML? That s easy. With this, we can operate with functions like cos(), sin(), any other trigonometric functions, sum () or product (). It does not matter what kind it is. We can use plus(), times() and everything which has its operator. kalgebra's console is useful as a calculator. There you <t>have</t> a list of the declared variables. By double clicking on them you will see a dialog that lets you change their values (just a way to trick the log).

Candidate senses:
1. sense_key=have%2:40:00:: | definition=have or possess, either in a concrete or an abstract sense | synonyms=have got, hold | examples=She has $1,000 in the bank; He has got two beautiful daughters
2. sense_key=have%2:42:00:: | definition=have as a feature | synonyms=feature | examples=This restaurant features the most famous chefs in France
3. sense_key=have%2:39:06:: | definition=go through (mental or physical states or experiences) | synonyms=experience, receive, get | examples=get an idea; experience vertigo
4. sense_key=have%2:40:04:: | definition=have ownership or possession of | synonyms=own, possess | examples=He owns three houses in Florida; How many cars does she have?
5. sense_key=have%2:30:00:: | definition=cause to move; cause to be in a certain position or condition | synonyms=get, let | examples=He got his squad on the ball; This let me in for a big surprise
6. sense_key=have%2:34:00:: | definition=serve oneself to, or consume regularly | synonyms=consume, ingest, take in, take | examples=Have another bowl of chicken soup!; I don't take sugar in my coffee
7. sense_key=have%2:41:00:: | definition=have a personal or business relationship with someone | examples=have a postdoc; have an assistant
8. sense_key=have%2:36:00:: | definition=organize or be responsible for | synonyms=hold, throw, make, give | examples=hold a reception; have, throw, or make a party
9. sense_key=have%2:40:01:: | definition=have left | examples=I have two years left; I don't have any money left
10. sense_key=have%2:42:12:: | definition=be confronted with | examples=What do we have here?; Now we have a fine mess
11. sense_key=have%2:30:01:: | definition=undergo | synonyms=experience | examples=The stocks had a fast run-up
12. sense_key=have%2:29:02:: | definition=suffer from; be ill with | examples=She has arthritis
13. sense_key=have%2:32:00:: | definition=cause to do; cause to act in a specified manner | synonyms=induce, stimulate, cause, get, make | examples=The ads induced me to buy a VCR; My children finally got me to buy a computer
14. sense_key=have%2:40:05:: | definition=receive willingly something given or offered | synonyms=accept, take | examples=The only girl who would have him was the miller's daughter; I won't have this dog in my house!
15. sense_key=have%2:40:03:: | definition=get something; come into possession of | synonyms=receive | examples=receive payment; receive a gift
16. sense_key=have%2:29:05:: | definition=undergo (as of injuries and illnesses) | synonyms=suffer, sustain, get | examples=She suffered a fracture in the accident; He had an insulin shock after eating three candy bars
17. sense_key=have%2:40:02:: | definition=achieve a point or goal | synonyms=get, make | examples=Nicklaus had a 70; The Brazilian team got 4 goals
18. sense_key=have%2:29:00:: | definition=cause to be born | synonyms=give birth, deliver, bear, birth | examples=My wife had twins yesterday!
19. sense_key=have%2:35:00:: | definition=have sex with; archaic use | synonyms=take | examples=He had taken this woman when she was most vulnerable

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    have or possess, either in a concrete or an abstract sense

    have%2:40:00:: · have.v.01

    • She has $1,000 in the bank
    • He has got two beautiful daughters

    Synonyms: have got, hold

    Gold Raganato Selected
  2. 2

    have as a feature

    have%2:42:00:: · have.v.02

    • This restaurant features the most famous chefs in France

    Synonyms: feature

    Gold Raganato
  3. 3

    go through (mental or physical states or experiences)

    have%2:39:06:: · experience.v.03

    • get an idea
    • experience vertigo

    Synonyms: experience, receive, get

  4. 4

    have ownership or possession of

    have%2:40:04:: · own.v.01

    • He owns three houses in Florida
    • How many cars does she have?

    Synonyms: own, possess

  5. 5

    cause to move; cause to be in a certain position or condition

    have%2:30:00:: · get.v.03

    • He got his squad on the ball
    • This let me in for a big surprise

    Synonyms: get, let

  6. 6

    serve oneself to, or consume regularly

    have%2:34:00:: · consume.v.02

    • Have another bowl of chicken soup!
    • I don't take sugar in my coffee

    Synonyms: consume, ingest, take in, take

  7. 7

    have a personal or business relationship with someone

    have%2:41:00:: · have.v.07

    • have a postdoc
    • have an assistant
  8. 8

    organize or be responsible for

    have%2:36:00:: · hold.v.03

    • hold a reception
    • have, throw, or make a party

    Synonyms: hold, throw, make, give

  9. 9

    have left

    have%2:40:01:: · have.v.09

    • I have two years left
    • I don't have any money left
  10. 10

    be confronted with

    have%2:42:12:: · have.v.10

    • What do we have here?
    • Now we have a fine mess
    Gold lexEN Gold Maru 2022
  11. 11

    undergo

    have%2:30:01:: · have.v.11

    • The stocks had a fast run-up

    Synonyms: experience

  12. 12

    suffer from; be ill with

    have%2:29:02:: · have.v.12

    • She has arthritis
  13. 13

    cause to do; cause to act in a specified manner

    have%2:32:00:: · induce.v.02

    • The ads induced me to buy a VCR
    • My children finally got me to buy a computer

    Synonyms: induce, stimulate, cause, get, make

  14. 14

    receive willingly something given or offered

    have%2:40:05:: · accept.v.02

    • The only girl who would have him was the miller's daughter
    • I won't have this dog in my house!

    Synonyms: accept, take

  15. 15

    get something; come into possession of

    have%2:40:03:: · receive.v.01

    • receive payment
    • receive a gift

    Synonyms: receive

  16. 16

    undergo (as of injuries and illnesses)

    have%2:29:05:: · suffer.v.02

    • She suffered a fracture in the accident
    • He had an insulin shock after eating three candy bars

    Synonyms: suffer, sustain, get

  17. 17

    achieve a point or goal

    have%2:40:02:: · have.v.17

    • Nicklaus had a 70
    • The Brazilian team got 4 goals

    Synonyms: get, make

  18. 18

    cause to be born

    have%2:29:00:: · give_birth.v.01

    • My wife had twins yesterday!

    Synonyms: give birth, deliver, bear, birth

  19. 19

    have sex with; archaic use

    have%2:35:00:: · take.v.35

    • He had taken this woman when she was most vulnerable

    Synonyms: take

change Verb

Instance: semeval2015.d001.s034.t005 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

It does not matter what kind it is.

We can use plus(), times() and everything which has its operator.

kalgebra's console is useful as a calculator.

There you have a list of the declared variables.

By double clicking on them you will see a dialog that lets you change their values (just a way to trick the log).

Every time you enter an expression, the " ans " variable value will be changed to the last result.

Ctrl N New Window

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: change
Target surface form: changed
Context:
It does not matter what kind it is. We can use plus(), times() and everything which has its operator. kalgebra's console is useful as a calculator. There you have a list of the declared variables. By double clicking on them you will see a dialog that lets you change their values (just a way to trick the log). Every time you enter an expression, the " ans " variable value will be <t>changed</t> to the last result. Ctrl N New Window

Candidate senses:
1. sense_key=change%2:30:01:: | definition=cause to change; make different; cause a transformation | synonyms=alter, modify | examples=The advent of the automobile may have altered the growth pattern of the city; The discussion has changed my thinking about the issue
2. sense_key=change%2:30:00:: | definition=undergo a change; become different in essence; losing one's or its original nature | examples=She changed completely as she grew older; The weather changed last night
3. sense_key=change%2:30:02:: | definition=become different in some particular way, without permanently losing one's or its former characteristics or essence | synonyms=alter, vary | examples=her mood changes in accordance with the weather; The supermarket's selection of vegetables varies according to the season
4. sense_key=change%2:30:05:: | definition=lay aside, abandon, or leave for another | synonyms=switch, shift | examples=switch to a different brand of beer; She switched psychiatrists
5. sense_key=change%2:30:03:: | definition=change clothes; put on different clothes | examples=Change before you go to the opera
6. sense_key=change%2:30:04:: | definition=exchange or replace with another, usually of the same kind or category | synonyms=exchange, commute, convert | examples=Could you convert my dollars into pounds?; He changed his name
7. sense_key=change%2:40:00:: | definition=give to, and receive from, one another | synonyms=exchange, interchange | examples=Would you change places with me?; We have been exchanging letters for a year
8. sense_key=change%2:38:00:: | definition=change from one vehicle or transportation line to another | synonyms=transfer | examples=She changed in Chicago on her way to the East coast
9. sense_key=change%2:30:08:: | definition=become deeper in tone | synonyms=deepen | examples=His voice began to change when he was 12 years old; Her voice deepened when she whispered the password
10. sense_key=change%2:30:06:: | definition=remove or replace the coverings of | examples=Father had to learn how to change the baby; After each guest we changed the bed linens

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    cause to change; make different; cause a transformation

    change%2:30:01:: · change.v.01

    • The advent of the automobile may have altered the growth pattern of the city
    • The discussion has changed my thinking about the issue

    Synonyms: alter, modify

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    undergo a change; become different in essence; losing one's or its original nature

    change%2:30:00:: · change.v.02

    • She changed completely as she grew older
    • The weather changed last night
  3. 3

    become different in some particular way, without permanently losing one's or its former characteristics or essence

    change%2:30:02:: · change.v.03

    • her mood changes in accordance with the weather
    • The supermarket's selection of vegetables varies according to the season

    Synonyms: alter, vary

  4. 4

    lay aside, abandon, or leave for another

    change%2:30:05:: · switch.v.03

    • switch to a different brand of beer
    • She switched psychiatrists

    Synonyms: switch, shift

  5. 5

    change clothes; put on different clothes

    change%2:30:03:: · change.v.05

    • Change before you go to the opera
  6. 6

    exchange or replace with another, usually of the same kind or category

    change%2:30:04:: · change.v.06

    • Could you convert my dollars into pounds?
    • He changed his name

    Synonyms: exchange, commute, convert

    Selected
  7. 7

    give to, and receive from, one another

    change%2:40:00:: · exchange.v.01

    • Would you change places with me?
    • We have been exchanging letters for a year

    Synonyms: exchange, interchange

  8. 8

    change from one vehicle or transportation line to another

    change%2:38:00:: · transfer.v.06

    • She changed in Chicago on her way to the East coast

    Synonyms: transfer

  9. 9

    become deeper in tone

    change%2:30:08:: · deepen.v.04

    • His voice began to change when he was 12 years old
    • Her voice deepened when she whispered the password

    Synonyms: deepen

  10. 10

    remove or replace the coverings of

    change%2:30:06:: · change.v.10

    • Father had to learn how to change the baby
    • After each guest we changed the bed linens

print Verb

Instance: semeval2015.d001.s044.t005 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Nice if you want to define some libraries or resume some previous work.

Ctrl G Save Script

Saves the instructions you have typed since the session began to be able to reuse.

Generates text files so it should be easy to fix using any text editor, like Kate.

Ctrl S Save Log

Saves the log with all results into an HTML file to be able to print or publish.

Ctrl Q Quit

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: print
Target surface form: print
Context:
Nice if you want to define some libraries or resume some previous work. Ctrl G Save Script Saves the instructions you have typed since the session began to be able to reuse. Generates text files so it should be easy to fix using any text editor, like Kate. Ctrl S Save Log Saves the log with all results into an HTML file to be able to <t>print</t> or publish. Ctrl Q Quit

Candidate senses:
1. sense_key=print%2:36:02:: | definition=put into print | synonyms=publish | examples=The newspaper published the news of the royal couple's divorce; These news should not be printed
2. sense_key=print%2:36:03:: | definition=write as if with print; not cursive
3. sense_key=print%2:36:01:: | definition=make into a print | examples=print the negative
4. sense_key=print%2:36:00:: | definition=reproduce by printing | synonyms=impress

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    put into print

    print%2:36:02:: · print.v.01

    • The newspaper published the news of the royal couple's divorce
    • These news should not be printed

    Synonyms: publish

  2. 2

    write as if with print; not cursive

    print%2:36:03:: · print.v.02

  3. 3

    make into a print

    print%2:36:01:: · print.v.03

    • print the negative
    Selected
  4. 4

    reproduce by printing

    print%2:36:00:: · print.v.04

    Synonyms: impress

    Gold lexEN Gold Maru 2022 Gold Raganato