Verified run

claude-haiku-5-5

claude-haiku-5.5-medium-reasoning-p004-lexen-v1-20261009

Rank
104
Accuracy lexEN v1 · WordNet fine
91.38%
Correct
4442 / 4861
Actual run cost
$0.706
Cost / M items
$145

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 91.38% 4442 / 4861 96.96% 4713 / 4861 94.63% 4600 / 4861
Maru 2022 (ALLamended) 88.42% 4298 / 4861 95.95% 4664 / 4861 92.74% 4508 / 4861
Raganato 2017 (original) 82.66% 4018 / 4861 93.38% 4539 / 4861 88.89% 4321 / 4861

Model

Display
claude-haiku-5-5
Requested
claude-haiku-5-5
Resolved
claude-haiku-5-5
Vendor
Anthropic
API provider
Anthropic
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
medium
Model URL
n/a
Endpoint
n/a
Resolved counts
claude-haiku-5-5: 4861

Reproducibility

Created
2026-10-09T12:46:44.272647+00:00
Run schema
sensebench-run-v2
Commit
9040664a78ce4afacbe5400eaf6538ee664f3dea
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p004
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
4,944,987
Tokens / item
1,017.3
Total cost
$0.706
Cost / M items
$145
Cost source
litellm_estimate
Elapsed
1.74m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
32,768
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.706. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 4,417,330 $0.442 $0.100
Input cached 0 $0.00 $0.0100
Output 527,657 $0.264 $0.500
Reasoning output 0 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 88.79% 705 794
Candidate Count 2 95.79% 819 855
Candidate Count 3-5 91.26% 1775 1945
Candidate Count 6-10 90.21% 1143 1267
POS ADJ 91.35% 602 659
POS ADV 89.23% 174 195
POS NOUN 92.82% 2689 2897
POS VERB 88.02% 977 1110
Source Dataset semeval2013 95.09% 1084 1140
Source Dataset semeval2015 91.20% 674 739
Source Dataset senseval2 90.42% 1473 1629
Source Dataset senseval3 89.50% 1211 1353

Worst-Bucket Examples

reach Verb

Instance: semeval2015.d000.s001.t009 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

This document is a summary of the European Public Assessment Report (EPAR).

It explains how the Committee for Medicinal Products for Human Use (CHMP) assessed the studies performed, to reach their recommendations on how to use the medicine.

If you need more information about your medical condition or your treatment, read the Package Leaflet (also part of the EPAR) or contact your doctor or pharmacist.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: reach
Target surface form: reach
Context:
This document is a summary of the European Public Assessment Report (EPAR). It explains how the Committee for Medicinal Products for Human Use (CHMP) assessed the studies performed, to <t>reach</t> their recommendations on how to use the medicine. If you need more information about your medical condition or your treatment, read the Package Leaflet (also part of the EPAR) or contact your doctor or pharmacist.

Candidate senses:
1. sense_key=reach%2:38:01:: | definition=reach a destination, either real or abstract | synonyms=make, attain, hit, arrive at, gain | examples=We hit Detroit by noon; The water reached the doorstep
2. sense_key=reach%2:32:00:: | definition=be in or establish communication with | synonyms=get through, get hold of, contact | examples=Our advertisements reach millions; He never contacted his children after he emigrated to Australia
3. sense_key=reach%2:42:00:: | definition=to extend as far as | synonyms=extend to, touch | examples=The sunlight reached the wall; Can he reach?
4. sense_key=reach%2:33:00:: | definition=to exert much effort or energy | synonyms=strive, strain | examples=straining our ears to hear
5. sense_key=reach%2:40:00:: | definition=place into the hands or custody of | synonyms=pass, hand, pass on, turn over, give | examples=hand me the spoon, please; Turn the files over to me, please
6. sense_key=reach%2:38:00:: | definition=reach a point in time, or a certain state or level | synonyms=hit, attain | examples=The thermometer hit 100 degrees; This car can reach a speed of 140 miles per hour
7. sense_key=reach%2:38:06:: | definition=reach a goal, e.g., | synonyms=make, get to, progress to | examples=make the first team; We made it!
8. sense_key=reach%2:41:00:: | definition=to gain with effort | synonyms=achieve, accomplish, attain | examples=she achieved her goal despite setbacks
9. sense_key=reach%2:35:00:: | definition=move forward or upward in order to touch; also in a metaphorical sense | synonyms=reach out | examples=Government reaches out to the people

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    reach a destination, either real or abstract

    reach%2:38:01:: · reach.v.01

    • We hit Detroit by noon
    • The water reached the doorstep

    Synonyms: make, attain, hit, arrive at, gain

    Selected
  2. 2

    be in or establish communication with

    reach%2:32:00:: · reach.v.04

    • Our advertisements reach millions
    • He never contacted his children after he emigrated to Australia

    Synonyms: get through, get hold of, contact

  3. 3

    to extend as far as

    reach%2:42:00:: · reach.v.06

    • The sunlight reached the wall
    • Can he reach?

    Synonyms: extend to, touch

  4. 4

    to exert much effort or energy

    reach%2:33:00:: · strive.v.02

    • straining our ears to hear

    Synonyms: strive, strain

  5. 5

    place into the hands or custody of

    reach%2:40:00:: · pass.v.05

    • hand me the spoon, please
    • Turn the files over to me, please

    Synonyms: pass, hand, pass on, turn over, give

  6. 6

    reach a point in time, or a certain state or level

    reach%2:38:00:: · reach.v.02

    • The thermometer hit 100 degrees
    • This car can reach a speed of 140 miles per hour

    Synonyms: hit, attain

  7. 7

    reach a goal, e.g.,

    reach%2:38:06:: · reach.v.07

    • make the first team
    • We made it!

    Synonyms: make, get to, progress to

    Gold lexEN Gold Maru 2022 Gold Raganato
  8. 8

    to gain with effort

    reach%2:41:00:: · achieve.v.01

    • she achieved her goal despite setbacks

    Synonyms: achieve, accomplish, attain

    Gold lexEN Gold Maru 2022 Gold Raganato
  9. 9

    move forward or upward in order to touch; also in a metaphorical sense

    reach%2:35:00:: · reach.v.03

    • Government reaches out to the people

    Synonyms: reach out

affect Verb

Instance: semeval2015.d000.s009.t027 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

What is Alimta?

Alimta is a powder that is made up into a solution for infusion (drip into a vein).

It contains the active substance pemetrexed.

What is Alimta used for?

Alimta is used to treat two types of cancer: pleural mesothelioma (cancer of the lining of the lungs that is usually caused by exposure to asbestos).

Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread easily, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not affecting the squamous cells.

Alimta is used in combination with cisplatin in patients who have not been treated before, and on its own in patients who have received another type of chemotherapy in the past.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: affect
Target surface form: affecting
Context:
What is Alimta? Alimta is a powder that is made up into a solution for infusion (drip into a vein). It contains the active substance pemetrexed. What is Alimta used for? Alimta is used to treat two types of cancer: pleural mesothelioma (cancer of the lining of the lungs that is usually caused by exposure to asbestos). Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread easily, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not <t>affecting</t> the squamous cells. Alimta is used in combination with cisplatin in patients who have not been treated before, and on its own in patients who have received another type of chemotherapy in the past.

Candidate senses:
1. sense_key=affect%2:42:00:: | definition=connect closely and often incriminatingly | synonyms=involve, regard | examples=This new ruling affects your business
2. sense_key=affect%2:30:00:: | definition=have an effect upon | synonyms=impact, bear upon, bear on, touch on, touch | examples=Will the new rules affect me?
3. sense_key=affect%2:37:00:: | definition=have an emotional or cognitive impact upon | synonyms=impress, move, strike | examples=This child impressed me as unusually mature; This behavior struck me as odd
4. sense_key=affect%2:32:00:: | definition=make believe with the intent to deceive | synonyms=feign, sham, pretend, dissemble | examples=He feigned that he was ill; He shammed a headache
5. sense_key=affect%2:29:00:: | definition=act physically on; have an effect upon | examples=the medicine affects my heart rate

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    connect closely and often incriminatingly

    affect%2:42:00:: · involve.v.01

    • This new ruling affects your business

    Synonyms: involve, regard

    Selected
  2. 2

    have an effect upon

    affect%2:30:00:: · affect.v.01

    • Will the new rules affect me?

    Synonyms: impact, bear upon, bear on, touch on, touch

  3. 3

    have an emotional or cognitive impact upon

    affect%2:37:00:: · affect.v.05

    • This child impressed me as unusually mature
    • This behavior struck me as odd

    Synonyms: impress, move, strike

  4. 4

    make believe with the intent to deceive

    affect%2:32:00:: · feign.v.01

    • He feigned that he was ill
    • He shammed a headache

    Synonyms: feign, sham, pretend, dissemble

  5. 5

    act physically on; have an effect upon

    affect%2:29:00:: · affect.v.02

    • the medicine affects my heart rate
    Gold lexEN Gold Maru 2022 Gold Raganato

delay Verb

Instance: semeval2015.d000.s018.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy.

The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight).

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta.

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: delay
Target surface form: delayed
Context:
Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy. The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight). It is given once every three weeks as an intravenous infusion lasting 10 minutes. To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta. When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be <t>delayed</t> or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems.

Candidate senses:
1. sense_key=delay%2:42:00:: | definition=act later than planned, scheduled, or required | examples=Don't delay your application to graduate school or else it won't be considered
2. sense_key=delay%2:30:01:: | definition=stop or halt | synonyms=stay, detain | examples=Please stay the bloodshed!
3. sense_key=delay%2:30:00:: | definition=cause to be slowed down or delayed | synonyms=detain, hold up | examples=Traffic was delayed by the bad weather; she delayed the work that she didn't want to perform
4. sense_key=delay%2:30:05:: | definition=slow the growth or development of | synonyms=check, retard | examples=The brain damage will retard the child's language development

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    act later than planned, scheduled, or required

    delay%2:42:00:: · delay.v.02

    • Don't delay your application to graduate school or else it won't be considered
    Gold Raganato Selected
  2. 2

    stop or halt

    delay%2:30:01:: · stay.v.06

    • Please stay the bloodshed!

    Synonyms: stay, detain

  3. 3

    cause to be slowed down or delayed

    delay%2:30:00:: · delay.v.01

    • Traffic was delayed by the bad weather
    • she delayed the work that she didn't want to perform

    Synonyms: detain, hold up

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    slow the growth or development of

    delay%2:30:05:: · check.v.07

    • The brain damage will retard the child's language development

    Synonyms: check, retard

have Verb

Instance: semeval2015.d000.s018.t008 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy.

The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight).

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta.

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: have
Target surface form: have
Context:
Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy. The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight). It is given once every three weeks as an intravenous infusion lasting 10 minutes. To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta. When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who <t>have</t> certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems.

Candidate senses:
1. sense_key=have%2:40:01:: | definition=have left | examples=I have two years left; I don't have any money left
2. sense_key=have%2:40:02:: | definition=achieve a point or goal | synonyms=get, make | examples=Nicklaus had a 70; The Brazilian team got 4 goals
3. sense_key=have%2:40:04:: | definition=have ownership or possession of | synonyms=own, possess | examples=He owns three houses in Florida; How many cars does she have?
4. sense_key=have%2:40:05:: | definition=receive willingly something given or offered | synonyms=accept, take | examples=The only girl who would have him was the miller's daughter; I won't have this dog in my house!
5. sense_key=have%2:29:00:: | definition=cause to be born | synonyms=give birth, deliver, bear, birth | examples=My wife had twins yesterday!
6. sense_key=have%2:40:03:: | definition=get something; come into possession of | synonyms=receive | examples=receive payment; receive a gift
7. sense_key=have%2:41:00:: | definition=have a personal or business relationship with someone | examples=have a postdoc; have an assistant
8. sense_key=have%2:34:00:: | definition=serve oneself to, or consume regularly | synonyms=consume, ingest, take in, take | examples=Have another bowl of chicken soup!; I don't take sugar in my coffee
9. sense_key=have%2:39:06:: | definition=go through (mental or physical states or experiences) | synonyms=experience, receive, get | examples=get an idea; experience vertigo
10. sense_key=have%2:32:00:: | definition=cause to do; cause to act in a specified manner | synonyms=induce, stimulate, cause, get, make | examples=The ads induced me to buy a VCR; My children finally got me to buy a computer
11. sense_key=have%2:30:01:: | definition=undergo | synonyms=experience | examples=The stocks had a fast run-up
12. sense_key=have%2:29:05:: | definition=undergo (as of injuries and illnesses) | synonyms=suffer, sustain, get | examples=She suffered a fracture in the accident; He had an insulin shock after eating three candy bars
13. sense_key=have%2:36:00:: | definition=organize or be responsible for | synonyms=hold, throw, make, give | examples=hold a reception; have, throw, or make a party
14. sense_key=have%2:29:02:: | definition=suffer from; be ill with | examples=She has arthritis
15. sense_key=have%2:35:00:: | definition=have sex with; archaic use | synonyms=take | examples=He had taken this woman when she was most vulnerable
16. sense_key=have%2:30:00:: | definition=cause to move; cause to be in a certain position or condition | synonyms=get, let | examples=He got his squad on the ball; This let me in for a big surprise
17. sense_key=have%2:42:00:: | definition=have as a feature | synonyms=feature | examples=This restaurant features the most famous chefs in France
18. sense_key=have%2:40:00:: | definition=have or possess, either in a concrete or an abstract sense | synonyms=have got, hold | examples=She has $1,000 in the bank; He has got two beautiful daughters
19. sense_key=have%2:42:12:: | definition=be confronted with | examples=What do we have here?; Now we have a fine mess

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    have left

    have%2:40:01:: · have.v.09

    • I have two years left
    • I don't have any money left
  2. 2

    achieve a point or goal

    have%2:40:02:: · have.v.17

    • Nicklaus had a 70
    • The Brazilian team got 4 goals

    Synonyms: get, make

  3. 3

    have ownership or possession of

    have%2:40:04:: · own.v.01

    • He owns three houses in Florida
    • How many cars does she have?

    Synonyms: own, possess

  4. 4

    receive willingly something given or offered

    have%2:40:05:: · accept.v.02

    • The only girl who would have him was the miller's daughter
    • I won't have this dog in my house!

    Synonyms: accept, take

  5. 5

    cause to be born

    have%2:29:00:: · give_birth.v.01

    • My wife had twins yesterday!

    Synonyms: give birth, deliver, bear, birth

  6. 6

    get something; come into possession of

    have%2:40:03:: · receive.v.01

    • receive payment
    • receive a gift

    Synonyms: receive

  7. 7

    have a personal or business relationship with someone

    have%2:41:00:: · have.v.07

    • have a postdoc
    • have an assistant
  8. 8

    serve oneself to, or consume regularly

    have%2:34:00:: · consume.v.02

    • Have another bowl of chicken soup!
    • I don't take sugar in my coffee

    Synonyms: consume, ingest, take in, take

  9. 9

    go through (mental or physical states or experiences)

    have%2:39:06:: · experience.v.03

    • get an idea
    • experience vertigo

    Synonyms: experience, receive, get

    Gold lexEN Gold Maru 2022
  10. 10

    cause to do; cause to act in a specified manner

    have%2:32:00:: · induce.v.02

    • The ads induced me to buy a VCR
    • My children finally got me to buy a computer

    Synonyms: induce, stimulate, cause, get, make

  11. 11

    undergo

    have%2:30:01:: · have.v.11

    • The stocks had a fast run-up

    Synonyms: experience

    Gold lexEN Gold Maru 2022
  12. 12

    undergo (as of injuries and illnesses)

    have%2:29:05:: · suffer.v.02

    • She suffered a fracture in the accident
    • He had an insulin shock after eating three candy bars

    Synonyms: suffer, sustain, get

    Gold Raganato
  13. 13

    organize or be responsible for

    have%2:36:00:: · hold.v.03

    • hold a reception
    • have, throw, or make a party

    Synonyms: hold, throw, make, give

  14. 14

    suffer from; be ill with

    have%2:29:02:: · have.v.12

    • She has arthritis
    Gold Raganato Selected
  15. 15

    have sex with; archaic use

    have%2:35:00:: · take.v.35

    • He had taken this woman when she was most vulnerable

    Synonyms: take

  16. 16

    cause to move; cause to be in a certain position or condition

    have%2:30:00:: · get.v.03

    • He got his squad on the ball
    • This let me in for a big surprise

    Synonyms: get, let

  17. 17

    have as a feature

    have%2:42:00:: · have.v.02

    • This restaurant features the most famous chefs in France

    Synonyms: feature

  18. 18

    have or possess, either in a concrete or an abstract sense

    have%2:40:00:: · have.v.01

    • She has $1,000 in the bank
    • He has got two beautiful daughters

    Synonyms: have got, hold

  19. 19

    be confronted with

    have%2:42:12:: · have.v.10

    • What do we have here?
    • Now we have a fine mess

see Verb

Instance: semeval2015.d000.s020.t002 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta.

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: see
Target surface form: see
Context:
It is given once every three weeks as an intravenous infusion lasting 10 minutes. To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta. When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, <t>see</t> the Summary of Product Characteristics (also part of the EPAR). How does Alimta work?

Candidate senses:
1. sense_key=see%2:41:12:: | definition=go to see for a social visit | examples=I went to see my friend Mary the other day
2. sense_key=see%2:39:02:: | definition=perceive or be contemporaneous with | synonyms=witness, find | examples=We found Republicans winning the offices; You'll see a lot of cheating in this school
3. sense_key=see%2:38:03:: | definition=accompany or escort | synonyms=escort | examples=I'll see you to the door
4. sense_key=see%2:39:03:: | definition=see or watch | synonyms=watch, view, catch, take in | examples=view a show on television; This program will be seen all over the world
5. sense_key=see%2:39:12:: | definition=go or live through | synonyms=experience, go through | examples=We had many trials to go through; he saw action in Viet Nam
6. sense_key=see%2:31:00:: | definition=deem to be | synonyms=consider, reckon, view, regard | examples=She views this quite differently from me; I consider her to be shallow
7. sense_key=see%2:35:09:: | definition=receive as a specified guest | examples=the doctor will see you now; The minister doesn't see anybody before noon
8. sense_key=see%2:39:05:: | definition=see and understand, have a good eye | examples=The artist must first learn to see
9. sense_key=see%2:41:14:: | definition=take charge of or deal with | synonyms=attend, take care, look | examples=Could you see about lunch?; I must attend to this matter
10. sense_key=see%2:39:11:: | definition=observe as if with an eye | examples=The camera saw the burglary and recorded it
11. sense_key=see%2:33:00:: | definition=match or meet | examples=I saw the bet of one of my fellow players
12. sense_key=see%2:41:00:: | definition=date regularly; have a steady relationship with | synonyms=go steady, go out, date | examples=Did you know that she is seeing an older man?; He is dating his former wife again!
13. sense_key=see%2:31:01:: | definition=perceive (an idea or situation) mentally | synonyms=understand, realize, realise | examples=Now I see!; I just can't see your point
14. sense_key=see%2:38:00:: | definition=come together | synonyms=meet, run into, encounter, run across, come across | examples=I'll probably see you at the meeting; How nice to see you again!
15. sense_key=see%2:39:13:: | definition=observe, check out, and look over carefully or inspect | synonyms=examine | examples=The customs agent examined the baggage; I must see your passport before you can enter the country
16. sense_key=see%2:31:02:: | definition=get to know or become aware of, usually accidentally | synonyms=learn, hear, get word, get wind, pick up, find out | examples=I learned that she has two grown-up children; I see that you have been promoted
17. sense_key=see%2:31:03:: | definition=be careful or certain to do something; make certain of something | synonyms=check, insure, see to it, ensure, control, ascertain | examples=He verified that the valves were closed; See that the curtains are closed
18. sense_key=see%2:39:00:: | definition=perceive by sight or have the power to perceive by sight | examples=You have to be a good observer to see all the details; Can you see the bird in that tree?
19. sense_key=see%2:36:00:: | definition=imagine; conceive of; see in one's mind | synonyms=visualize, visualise, envision, project, fancy, figure | examples=I can't see him on horseback!; I can see what will happen
20. sense_key=see%2:41:11:: | definition=go to see for professional or business reasons | examples=You should see a lawyer; We had to see a psychiatrist
21. sense_key=see%2:41:10:: | definition=go to see a place, as for entertainment | synonyms=visit | examples=We went to see the Eiffel Tower in the morning
22. sense_key=see%2:31:13:: | definition=make sense of; assign a meaning to | synonyms=interpret, construe | examples=What message do you see in this letter?; How do you interpret his behavior?
23. sense_key=see%2:31:08:: | definition=deliberate or decide | examples=See whether you can come tomorrow; let's see--which movie should we see tonight?
24. sense_key=see%2:32:00:: | definition=find out, learn, or determine with certainty, usually by making an inquiry or other effort | synonyms=determine, check, find out, ascertain, watch, learn | examples=I want to see whether she speaks French; See whether it works

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    go to see for a social visit

    see%2:41:12:: · see.v.12

    • I went to see my friend Mary the other day
  2. 2

    perceive or be contemporaneous with

    see%2:39:02:: · witness.v.02

    • We found Republicans winning the offices
    • You'll see a lot of cheating in this school

    Synonyms: witness, find

  3. 3

    accompany or escort

    see%2:38:03:: · see.v.22

    • I'll see you to the door

    Synonyms: escort

  4. 4

    see or watch

    see%2:39:03:: · watch.v.03

    • view a show on television
    • This program will be seen all over the world

    Synonyms: watch, view, catch, take in

  5. 5

    go or live through

    see%2:39:12:: · experience.v.01

    • We had many trials to go through
    • he saw action in Viet Nam

    Synonyms: experience, go through

  6. 6

    deem to be

    see%2:31:00:: · see.v.05

    • She views this quite differently from me
    • I consider her to be shallow

    Synonyms: consider, reckon, view, regard

  7. 7

    receive as a specified guest

    see%2:35:09:: · see.v.15

    • the doctor will see you now
    • The minister doesn't see anybody before noon
  8. 8

    see and understand, have a good eye

    see%2:39:05:: · see.v.17

    • The artist must first learn to see
  9. 9

    take charge of or deal with

    see%2:41:14:: · attend.v.02

    • Could you see about lunch?
    • I must attend to this matter

    Synonyms: attend, take care, look

  10. 10

    observe as if with an eye

    see%2:39:11:: · see.v.19

    • The camera saw the burglary and recorded it
  11. 11

    match or meet

    see%2:33:00:: · see.v.23

    • I saw the bet of one of my fellow players
  12. 12

    date regularly; have a steady relationship with

    see%2:41:00:: · go_steady.v.01

    • Did you know that she is seeing an older man?
    • He is dating his former wife again!

    Synonyms: go steady, go out, date

  13. 13

    perceive (an idea or situation) mentally

    see%2:31:01:: · understand.v.02

    • Now I see!
    • I just can't see your point

    Synonyms: understand, realize, realise

  14. 14

    come together

    see%2:38:00:: · meet.v.01

    • I'll probably see you at the meeting
    • How nice to see you again!

    Synonyms: meet, run into, encounter, run across, come across

  15. 15

    observe, check out, and look over carefully or inspect

    see%2:39:13:: · examine.v.02

    • The customs agent examined the baggage
    • I must see your passport before you can enter the country

    Synonyms: examine

    Gold lexEN Gold Maru 2022 Gold Raganato
  16. 16

    get to know or become aware of, usually accidentally

    see%2:31:02:: · learn.v.02

    • I learned that she has two grown-up children
    • I see that you have been promoted

    Synonyms: learn, hear, get word, get wind, pick up, find out, get a line, discover

  17. 17

    be careful or certain to do something; make certain of something

    see%2:31:03:: · see.v.10

    • He verified that the valves were closed
    • See that the curtains are closed

    Synonyms: check, insure, see to it, ensure, control, ascertain, assure

  18. 18

    perceive by sight or have the power to perceive by sight

    see%2:39:00:: · see.v.01

    • You have to be a good observer to see all the details
    • Can you see the bird in that tree?
  19. 19

    imagine; conceive of; see in one's mind

    see%2:36:00:: · visualize.v.01

    • I can't see him on horseback!
    • I can see what will happen

    Synonyms: visualize, visualise, envision, project, fancy, figure, picture, image

  20. 20

    go to see for professional or business reasons

    see%2:41:11:: · see.v.11

    • You should see a lawyer
    • We had to see a psychiatrist
  21. 21

    go to see a place, as for entertainment

    see%2:41:10:: · visit.v.01

    • We went to see the Eiffel Tower in the morning

    Synonyms: visit

  22. 22

    make sense of; assign a meaning to

    see%2:31:13:: · interpret.v.01

    • What message do you see in this letter?
    • How do you interpret his behavior?

    Synonyms: interpret, construe

  23. 23

    deliberate or decide

    see%2:31:08:: · see.v.18

    • See whether you can come tomorrow
    • let's see--which movie should we see tonight?
  24. 24

    find out, learn, or determine with certainty, usually by making an inquiry or other effort

    see%2:32:00:: · determine.v.08

    • I want to see whether she speaks French
    • See whether it works

    Synonyms: determine, check, find out, ascertain, watch, learn

    Selected

convert Verb

Instance: semeval2015.d000.s023.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: convert
Target surface form: converted
Context:
Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is <t>converted</t> into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied?

Candidate senses:
1. sense_key=convert%2:33:01:: | definition=complete successfully | examples=score a penalty shot or free throw
2. sense_key=convert%2:30:07:: | definition=cause to adopt a new or different faith | examples=The missionaries converted the Indian population
3. sense_key=convert%2:32:00:: | definition=make (someone) agree, understand, or realize the truth or validity of something | synonyms=win over, convince | examples=He had finally convinced several customers of the advantages of his product
4. sense_key=convert%2:30:04:: | definition=change in nature, purpose, or function; undergo a chemical change | examples=The substance converts to an acid
5. sense_key=convert%2:33:02:: | definition=score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone | examples=Smith converted and his team won
6. sense_key=convert%2:30:09:: | definition=exchange a penalty for a less severe one | synonyms=commute, exchange
7. sense_key=convert%2:30:03:: | definition=change the nature, purpose, or function of something | examples=convert lead into gold; convert hotels into jails
8. sense_key=convert%2:30:00:: | definition=change from one system to another or to a new plan or policy | synonyms=change over | examples=We converted from 220 to 110 Volt
9. sense_key=convert%2:30:01:: | definition=change religious beliefs, or adopt a religious belief | examples=She converted to Buddhism
10. sense_key=convert%2:30:02:: | definition=exchange or replace with another, usually of the same kind or category | synonyms=change, exchange, commute | examples=Could you convert my dollars into pounds?; He changed his name
11. sense_key=convert%2:33:00:: | definition=score (a spare)

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    complete successfully

    convert%2:33:01:: · convert.v.07

    • score a penalty shot or free throw
  2. 2

    cause to adopt a new or different faith

    convert%2:30:07:: · convert.v.05

    • The missionaries converted the Indian population
  3. 3

    make (someone) agree, understand, or realize the truth or validity of something

    convert%2:32:00:: · convert.v.09

    • He had finally convinced several customers of the advantages of his product

    Synonyms: win over, convince

  4. 4

    change in nature, purpose, or function; undergo a chemical change

    convert%2:30:04:: · convert.v.11

    • The substance converts to an acid
    Gold Raganato Selected
  5. 5

    score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone

    convert%2:33:02:: · convert.v.06

    • Smith converted and his team won
  6. 6

    exchange a penalty for a less severe one

    convert%2:30:09:: · commute.v.04

    Synonyms: commute, exchange

  7. 7

    change the nature, purpose, or function of something

    convert%2:30:03:: · convert.v.02

    • convert lead into gold
    • convert hotels into jails
    Gold lexEN Gold Maru 2022 Gold Raganato
  8. 8

    change from one system to another or to a new plan or policy

    convert%2:30:00:: · convert.v.01

    • We converted from 220 to 110 Volt

    Synonyms: change over

  9. 9

    change religious beliefs, or adopt a religious belief

    convert%2:30:01:: · convert.v.03

    • She converted to Buddhism
  10. 10

    exchange or replace with another, usually of the same kind or category

    convert%2:30:02:: · change.v.06

    • Could you convert my dollars into pounds?
    • He changed his name

    Synonyms: change, exchange, commute

  11. 11

    score (a spare)

    convert%2:33:00:: · convert.v.08

block Verb

Instance: semeval2015.d000.s023.t004 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: block
Target surface form: blocks
Context:
Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is converted into an active form that <t>blocks</t> the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied?

Candidate senses:
1. sense_key=block%2:35:00:: | definition=render unsuitable for passage | synonyms=barricade, blockade, stop, block off, block up, bar | examples=block the way; barricade the streets
2. sense_key=block%2:35:06:: | definition=support, secure, or raise with a block | examples=block a plate for printing; block the wheels of a car
3. sense_key=block%2:39:05:: | definition=interrupt the normal function of by means of anesthesia | examples=block a nerve; block a muscle
4. sense_key=block%2:35:03:: | definition=stamp or emboss a title or design on a book with a block | examples=block the book cover
5. sense_key=block%2:30:01:: | definition=shape by using a block | examples=Block a hat; block a garment
6. sense_key=block%2:41:01:: | definition=stop from happening or developing | synonyms=stop, halt, kibosh | examples=Block his election; Halt the process
7. sense_key=block%2:39:00:: | definition=shut out from view or get in the way so as to hide from sight | synonyms=obstruct | examples=The thick curtain blocked the action on the stage; The trees obstruct my view of the mountains
8. sense_key=block%2:35:12:: | definition=block passage through | synonyms=obstruct, obturate, impede, occlude, jam, close up | examples=obstruct the path
9. sense_key=block%2:31:00:: | definition=be unable to remember | synonyms=forget, blank out, draw a blank | examples=I'm drawing a blank; You are blocking the name of your first wife!
10. sense_key=block%2:41:00:: | definition=hinder or prevent the progress or accomplishment of | synonyms=obstruct, blockade, hinder, stymie, stymy, embarrass | examples=His brother blocked him at every turn
11. sense_key=block%2:41:03:: | definition=run on a block system | examples=block trains
12. sense_key=block%2:35:02:: | definition=obstruct | synonyms=stuff, lug, choke up | examples=My nose is all stuffed; Her arteries are blocked
13. sense_key=block%2:30:00:: | definition=shape into a block or blocks | examples=block the graphs so one can see the results clearly
14. sense_key=block%2:30:02:: | definition=prohibit the conversion or use of (assets) | synonyms=freeze, immobilize, immobilise | examples=Blocked funds; Freeze the assets of this hostile government
15. sense_key=block%2:33:00:: | definition=impede the movement of (an opponent or a ball) | synonyms=parry, deflect | examples=block an attack
16. sense_key=block%2:32:00:: | definition=interfere with or prevent the reception of signals | synonyms=jam | examples=Jam the Voice of America; block the signals emitted by this station

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    render unsuitable for passage

    block%2:35:00:: · barricade.v.01

    • block the way
    • barricade the streets

    Synonyms: barricade, blockade, stop, block off, block up, bar

  2. 2

    support, secure, or raise with a block

    block%2:35:06:: · block.v.11

    • block a plate for printing
    • block the wheels of a car
  3. 3

    interrupt the normal function of by means of anesthesia

    block%2:39:05:: · block.v.06

    • block a nerve
    • block a muscle
  4. 4

    stamp or emboss a title or design on a book with a block

    block%2:35:03:: · block.v.08

    • block the book cover
  5. 5

    shape by using a block

    block%2:30:01:: · block.v.14

    • Block a hat
    • block a garment
  6. 6

    stop from happening or developing

    block%2:41:01:: · stop.v.03

    • Block his election
    • Halt the process

    Synonyms: stop, halt, kibosh

    Gold lexEN Gold Maru 2022 Gold Raganato
  7. 7

    shut out from view or get in the way so as to hide from sight

    block%2:39:00:: · obstruct.v.03

    • The thick curtain blocked the action on the stage
    • The trees obstruct my view of the mountains

    Synonyms: obstruct

  8. 8

    block passage through

    block%2:35:12:: · obstruct.v.02

    • obstruct the path

    Synonyms: obstruct, obturate, impede, occlude, jam, close up

  9. 9

    be unable to remember

    block%2:31:00:: · forget.v.02

    • I'm drawing a blank
    • You are blocking the name of your first wife!

    Synonyms: forget, blank out, draw a blank

  10. 10

    hinder or prevent the progress or accomplishment of

    block%2:41:00:: · obstruct.v.01

    • His brother blocked him at every turn

    Synonyms: obstruct, blockade, hinder, stymie, stymy, embarrass

    Selected
  11. 11

    run on a block system

    block%2:41:03:: · block.v.05

    • block trains
  12. 12

    obstruct

    block%2:35:02:: · stuff.v.03

    • My nose is all stuffed
    • Her arteries are blocked

    Synonyms: stuff, lug, choke up

  13. 13

    shape into a block or blocks

    block%2:30:00:: · block.v.15

    • block the graphs so one can see the results clearly
  14. 14

    prohibit the conversion or use of (assets)

    block%2:30:02:: · freeze.v.08

    • Blocked funds
    • Freeze the assets of this hostile government

    Synonyms: freeze, immobilize, immobilise

  15. 15

    impede the movement of (an opponent or a ball)

    block%2:33:00:: · parry.v.01

    • block an attack

    Synonyms: parry, deflect

  16. 16

    interfere with or prevent the reception of signals

    block%2:32:00:: · jam.v.04

    • Jam the Voice of America
    • block the signals emitted by this station

    Synonyms: jam

produce Verb

Instance: semeval2015.d000.s023.t008 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: produce
Target surface form: producing
Context:
Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in <t>producing</t> nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied?

Candidate senses:
1. sense_key=produce%2:29:00:: | definition=come to have or undergo a change of (physical features and attributes) | synonyms=grow, develop, get, acquire | examples=He grew a beard; The patient developed abdominal pains
2. sense_key=produce%2:39:01:: | definition=bring out for display | synonyms=bring forth | examples=The proud father produced many pictures of his baby; The accused brought forth a letter in court that he claims exonerates him
3. sense_key=produce%2:36:00:: | definition=create or manufacture a man-made product | synonyms=make, create | examples=We produce more cars than we can sell; The company has been making toys for two centuries
4. sense_key=produce%2:39:00:: | definition=bring onto the market or release | synonyms=bring on, bring out | examples=produce a movie; bring out a book
5. sense_key=produce%2:36:03:: | definition=cause to happen, occur or exist | synonyms=bring about, give rise | examples=This procedure produces a curious effect; The new law gave rise to many complaints
6. sense_key=produce%2:36:05:: | definition=cultivate by growing, often involving improvements by means of agricultural techniques | synonyms=grow, raise, farm | examples=The Bordeaux region produces great red wines; They produce good ham in Parma
7. sense_key=produce%2:36:02:: | definition=bring forth or yield | synonyms=bring forth | examples=The tree would not produce fruit

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    come to have or undergo a change of (physical features and attributes)

    produce%2:29:00:: · grow.v.08

    • He grew a beard
    • The patient developed abdominal pains

    Synonyms: grow, develop, get, acquire

  2. 2

    bring out for display

    produce%2:39:01:: · produce.v.04

    • The proud father produced many pictures of his baby
    • The accused brought forth a letter in court that he claims exonerates him

    Synonyms: bring forth

  3. 3

    create or manufacture a man-made product

    produce%2:36:00:: · produce.v.02

    • We produce more cars than we can sell
    • The company has been making toys for two centuries

    Synonyms: make, create

    Selected
  4. 4

    bring onto the market or release

    produce%2:39:00:: · produce.v.06

    • produce a movie
    • bring out a book

    Synonyms: bring on, bring out

  5. 5

    cause to happen, occur or exist

    produce%2:36:03:: · produce.v.03

    • This procedure produces a curious effect
    • The new law gave rise to many complaints

    Synonyms: bring about, give rise

    Gold lexEN Gold Maru 2022
  6. 6

    cultivate by growing, often involving improvements by means of agricultural techniques

    produce%2:36:05:: · grow.v.07

    • The Bordeaux region produces great red wines
    • They produce good ham in Parma

    Synonyms: grow, raise, farm

  7. 7

    bring forth or yield

    produce%2:36:02:: · produce.v.01

    • The tree would not produce fruit

    Synonyms: bring forth

    Gold lexEN Gold Maru 2022 Gold Raganato

involve Verb

Instance: semeval2015.d000.s028.t006 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before.

The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone.

For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

In all three studies, the main measure of effectiveness was how long the patients survived.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: involve
Target surface form: involving
Context:
In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied? For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before. The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone. For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past. Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study <t>involving</t> 1,725 patients who had not received chemotherapy for lung cancer in the past. In all three studies, the main measure of effectiveness was how long the patients survived.

Candidate senses:
1. sense_key=involve%2:42:02:: | definition=contain as a part | examples=Dinner at Joe's always involves at least six courses
2. sense_key=involve%2:31:00:: | definition=occupy or engage the interest of | examples=His story completely involved me during the entire afternoon
3. sense_key=involve%2:42:07:: | definition=require as useful, just, or proper | synonyms=necessitate, ask, postulate, need, require, take | examples=It takes nerve to do what she did; success usually requires hard work
4. sense_key=involve%2:42:04:: | definition=engage as a participant | examples=Don't involve me in your family affairs!
5. sense_key=involve%2:30:00:: | definition=make complex or intricate or complicated | examples=The situation was rather involved
6. sense_key=involve%2:42:01:: | definition=connect closely and often incriminatingly | synonyms=affect, regard | examples=This new ruling affects your business
7. sense_key=involve%2:42:00:: | definition=have as a necessary feature | synonyms=imply | examples=This decision involves many changes

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    contain as a part

    involve%2:42:02:: · involve.v.05

    • Dinner at Joe's always involves at least six courses
    Selected
  2. 2

    occupy or engage the interest of

    involve%2:31:00:: · involve.v.06

    • His story completely involved me during the entire afternoon
  3. 3

    require as useful, just, or proper

    involve%2:42:07:: · necessitate.v.01

    • It takes nerve to do what she did
    • success usually requires hard work

    Synonyms: necessitate, ask, postulate, need, require, take, call for, demand

  4. 4

    engage as a participant

    involve%2:42:04:: · involve.v.02

    • Don't involve me in your family affairs!
    Gold lexEN Gold Maru 2022 Gold Raganato
  5. 5

    make complex or intricate or complicated

    involve%2:30:00:: · involve.v.07

    • The situation was rather involved
  6. 6

    connect closely and often incriminatingly

    involve%2:42:01:: · involve.v.01

    • This new ruling affects your business

    Synonyms: affect, regard

  7. 7

    have as a necessary feature

    involve%2:42:00:: · imply.v.05

    • This decision involves many changes

    Synonyms: imply

show Verb

Instance: semeval2015.d000.s030.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before.

The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone.

For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

In all three studies, the main measure of effectiveness was how long the patients survived.

What benefit has Alimta shown during the studies?

Alimta increased the survival time of patients with malignant pleural mesothelioma.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: show
Target surface form: shown
Context:
For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before. The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone. For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past. Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past. In all three studies, the main measure of effectiveness was how long the patients survived. What benefit has Alimta <t>shown</t> during the studies? Alimta increased the survival time of patients with malignant pleural mesothelioma.

Candidate senses:
1. sense_key=show%2:32:03:: | definition=give evidence of, as of records | examples=The diary shows his distress that evening
2. sense_key=show%2:36:00:: | definition=show in, or as in, a picture | synonyms=picture, depict, render | examples=This scene depicts country life; the face of the child is rendered with much tenderness in this painting
3. sense_key=show%2:32:00:: | definition=provide evidence for | synonyms=testify, bear witness, prove, evidence | examples=The blood test showed that he was the father; Her behavior testified to her incompetence
4. sense_key=show%2:39:01:: | definition=be or become visible or noticeable | synonyms=show up | examples=His good upbringing really shows; The dirty side will show
5. sense_key=show%2:32:02:: | definition=give expression to | synonyms=express, evince | examples=She showed her disappointment
6. sense_key=show%2:38:00:: | definition=take (someone) to their seats, as in theaters or auditoriums | synonyms=usher | examples=The usher showed us to our seats
7. sense_key=show%2:32:01:: | definition=indicate a place, direction, person, or thing; either spatially or figuratively | synonyms=indicate, point, designate | examples=I showed the customer the glove section; He pointed to the empty parking space
8. sense_key=show%2:32:04:: | definition=indicate a certain reading; of gauges and instruments | synonyms=read, register, record | examples=The thermometer showed thirteen degrees below zero; The gauge read `empty'
9. sense_key=show%2:39:00:: | definition=make visible or noticeable | examples=She showed her talent for cooking; Show me your etchings, please
10. sense_key=show%2:31:00:: | definition=establish the validity of something, as by an example, explanation or experiment | synonyms=prove, demonstrate, establish, shew | examples=The experiment demonstrated the instability of the compound; The mathematician showed the validity of the conjecture
11. sense_key=show%2:33:00:: | definition=finish third or better in a horse or dog race | examples=he bet $2 on number six to show
12. sense_key=show%2:39:02:: | definition=give an exhibition of to an interested audience | synonyms=demo, exhibit, present, demonstrate | examples=She shows her dogs frequently; We will demo the new software in Washington

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    give evidence of, as of records

    show%2:32:03:: · show.v.10

    • The diary shows his distress that evening
    Selected
  2. 2

    show in, or as in, a picture

    show%2:36:00:: · picture.v.02

    • This scene depicts country life
    • the face of the child is rendered with much tenderness in this painting

    Synonyms: picture, depict, render

    Gold Raganato
  3. 3

    provide evidence for

    show%2:32:00:: · testify.v.02

    • The blood test showed that he was the father
    • Her behavior testified to her incompetence

    Synonyms: testify, bear witness, prove, evidence

    Gold lexEN Gold Maru 2022
  4. 4

    be or become visible or noticeable

    show%2:39:01:: · show.v.08

    • His good upbringing really shows
    • The dirty side will show

    Synonyms: show up

  5. 5

    give expression to

    show%2:32:02:: · express.v.01

    • She showed her disappointment

    Synonyms: express, evince

  6. 6

    take (someone) to their seats, as in theaters or auditoriums

    show%2:38:00:: · usher.v.01

    • The usher showed us to our seats

    Synonyms: usher

  7. 7

    indicate a place, direction, person, or thing; either spatially or figuratively

    show%2:32:01:: · indicate.v.02

    • I showed the customer the glove section
    • He pointed to the empty parking space

    Synonyms: indicate, point, designate

  8. 8

    indicate a certain reading; of gauges and instruments

    show%2:32:04:: · read.v.08

    • The thermometer showed thirteen degrees below zero
    • The gauge read `empty'

    Synonyms: read, register, record

  9. 9

    make visible or noticeable

    show%2:39:00:: · show.v.04

    • She showed her talent for cooking
    • Show me your etchings, please
    Gold lexEN Gold Maru 2022
  10. 10

    establish the validity of something, as by an example, explanation or experiment

    show%2:31:00:: · prove.v.02

    • The experiment demonstrated the instability of the compound
    • The mathematician showed the validity of the conjecture

    Synonyms: prove, demonstrate, establish, shew

    Gold Raganato
  11. 11

    finish third or better in a horse or dog race

    show%2:33:00:: · show.v.12

    • he bet $2 on number six to show
  12. 12

    give an exhibition of to an interested audience

    show%2:39:02:: · show.v.01

    • She shows her dogs frequently
    • We will demo the new software in Washington

    Synonyms: demo, exhibit, present, demonstrate

affect Verb

Instance: semeval2015.d000.s037.t003 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Patients receiving Alimta and cisplatin survived for an average of 12.1 months, compared with 9.3 months in those receiving cisplatin alone.

In the treatment of patients with non-small cell lung cancer, Alimta was as effective as the comparators.

In patients who had received chemotherapy in the past, the average survival time was 8.3 months with Alimta, compared with 7.9 months with docetaxel.

In patients who had not received chemotherapy in the past, the average survival time was 10.3 months in both groups.

However, in both studies, patients whose cancer was not affecting squamous cells had longer survival times if they received Alimta than if they received the comparator.

In contrast, patients whose cancer was affecting squamous cells had shorter survival times if they received Alimta.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: affect
Target surface form: affecting
Context:
Patients receiving Alimta and cisplatin survived for an average of 12.1 months, compared with 9.3 months in those receiving cisplatin alone. In the treatment of patients with non-small cell lung cancer, Alimta was as effective as the comparators. In patients who had received chemotherapy in the past, the average survival time was 8.3 months with Alimta, compared with 7.9 months with docetaxel. In patients who had not received chemotherapy in the past, the average survival time was 10.3 months in both groups. However, in both studies, patients whose cancer was not affecting squamous cells had longer survival times if they received Alimta than if they received the comparator. In contrast, patients whose cancer was <t>affecting</t> squamous cells had shorter survival times if they received Alimta.

Candidate senses:
1. sense_key=affect%2:37:00:: | definition=have an emotional or cognitive impact upon | synonyms=impress, move, strike | examples=This child impressed me as unusually mature; This behavior struck me as odd
2. sense_key=affect%2:30:00:: | definition=have an effect upon | synonyms=impact, bear upon, bear on, touch on, touch | examples=Will the new rules affect me?
3. sense_key=affect%2:42:00:: | definition=connect closely and often incriminatingly | synonyms=involve, regard | examples=This new ruling affects your business
4. sense_key=affect%2:32:00:: | definition=make believe with the intent to deceive | synonyms=feign, sham, pretend, dissemble | examples=He feigned that he was ill; He shammed a headache
5. sense_key=affect%2:29:00:: | definition=act physically on; have an effect upon | examples=the medicine affects my heart rate

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    have an emotional or cognitive impact upon

    affect%2:37:00:: · affect.v.05

    • This child impressed me as unusually mature
    • This behavior struck me as odd

    Synonyms: impress, move, strike

  2. 2

    have an effect upon

    affect%2:30:00:: · affect.v.01

    • Will the new rules affect me?

    Synonyms: impact, bear upon, bear on, touch on, touch

  3. 3

    connect closely and often incriminatingly

    affect%2:42:00:: · involve.v.01

    • This new ruling affects your business

    Synonyms: involve, regard

    Selected
  4. 4

    make believe with the intent to deceive

    affect%2:32:00:: · feign.v.01

    • He feigned that he was ill
    • He shammed a headache

    Synonyms: feign, sham, pretend, dissemble

  5. 5

    act physically on; have an effect upon

    affect%2:29:00:: · affect.v.02

    • the medicine affects my heart rate
    Gold lexEN Gold Maru 2022 Gold Raganato

find Verb

Instance: semeval2015.d001.s008.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

kalgebra is a MathML based graph calculator.

Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge.

Here's a screenshot of kalgebra main window

kalgebra main window

kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab.

Below these tabs you will find an input field to type your functions or do your calculations.

If we want to understand how it works, the best thing we can do is to realize that our input is being converted into MathML although it is not necessary to know MathML.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: find
Target surface form: find
Context:
kalgebra is a MathML based graph calculator. Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge. Here's a screenshot of kalgebra main window kalgebra main window kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab. Below these tabs you will <t>find</t> an input field to type your functions or do your calculations. If we want to understand how it works, the best thing we can do is to realize that our input is being converted into MathML although it is not necessary to know MathML.

Candidate senses:
1. sense_key=find%2:30:00:: | definition=receive a specified treatment (abstract) | synonyms=receive, get, obtain, incur | examples=These aspects of civilization do not find expression or receive an interpretation; His movie received a good review
2. sense_key=find%2:31:09:: | definition=make a discovery | synonyms=discover | examples=She found that he had lied to her; The story is false, so far as I can discover
3. sense_key=find%2:40:01:: | definition=get something or somebody for a specific purpose | synonyms=line up, get hold, come up | examples=I found this gadget that will serve as a bottle opener; I got hold of these tools to fix our plumbing
4. sense_key=find%2:39:05:: | definition=perceive oneself to be in a certain condition or place | examples=I found myself in a difficult situation; When he woke up, he found himself in a hospital room
5. sense_key=find%2:40:03:: | definition=obtain through effort or management | examples=She found the time and energy to take care of her aging parents; We found the money to send our sons to college
6. sense_key=find%2:40:15:: | definition=get or find back; recover the use of | synonyms=recover, retrieve, regain | examples=She regained control of herself; She found her voice and replied quickly
7. sense_key=find%2:32:00:: | definition=establish after a calculation, investigation, experiment, survey, or study | synonyms=determine, find out, ascertain | examples=find the product of two numbers; The physicist who found the elusive particle won the Nobel Prize
8. sense_key=find%2:38:10:: | definition=succeed in reaching; arrive at | examples=The arrow found its mark
9. sense_key=find%2:31:10:: | definition=come to believe on the basis of emotion, intuitions, or indefinite grounds | synonyms=feel | examples=I feel that he doesn't like me; I find him to be obnoxious
10. sense_key=find%2:32:01:: | definition=decide on and make a declaration about | synonyms=rule | examples=find someone guilty
11. sense_key=find%2:39:01:: | definition=perceive or be contemporaneous with | synonyms=witness, see | examples=We found Republicans winning the offices; You'll see a lot of cheating in this school
12. sense_key=find%2:30:13:: | definition=accept and make use of one's personality, abilities, and situation | synonyms=find oneself | examples=My son went to Berkeley to find himself
13. sense_key=find%2:40:02:: | definition=come upon, as if by accident; meet with | synonyms=happen, chance, bump, encounter | examples=We find this idea in Plato; I happened upon the most wonderful bakery not very far from here
14. sense_key=find%2:39:02:: | definition=discover or determine the existence, presence, or fact of | synonyms=detect, observe, discover, notice | examples=She detected high levels of lead in her drinking water; We found traces of lead in the paint
15. sense_key=find%2:40:00:: | definition=come upon after searching; find the location of something that was missed or lost | synonyms=regain | examples=Did you find your glasses?; I cannot find my gloves!
16. sense_key=find%2:36:00:: | definition=make a discovery, make a new finding | synonyms=discover | examples=Roentgen discovered X-rays; Physicists believe they found a new elementary particle

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    receive a specified treatment (abstract)

    find%2:30:00:: · receive.v.02

    • These aspects of civilization do not find expression or receive an interpretation
    • His movie received a good review

    Synonyms: receive, get, obtain, incur

  2. 2

    make a discovery

    find%2:31:09:: · discover.v.04

    • She found that he had lied to her
    • The story is false, so far as I can discover

    Synonyms: discover

  3. 3

    get something or somebody for a specific purpose

    find%2:40:01:: · line_up.v.02

    • I found this gadget that will serve as a bottle opener
    • I got hold of these tools to fix our plumbing

    Synonyms: line up, get hold, come up

  4. 4

    perceive oneself to be in a certain condition or place

    find%2:39:05:: · find.v.13

    • I found myself in a difficult situation
    • When he woke up, he found himself in a hospital room
  5. 5

    obtain through effort or management

    find%2:40:03:: · find.v.10

    • She found the time and energy to take care of her aging parents
    • We found the money to send our sons to college
  6. 6

    get or find back; recover the use of

    find%2:40:15:: · recover.v.01

    • She regained control of herself
    • She found her voice and replied quickly

    Synonyms: recover, retrieve, regain

  7. 7

    establish after a calculation, investigation, experiment, survey, or study

    find%2:32:00:: · determine.v.01

    • find the product of two numbers
    • The physicist who found the elusive particle won the Nobel Prize

    Synonyms: determine, find out, ascertain

  8. 8

    succeed in reaching; arrive at

    find%2:38:10:: · find.v.15

    • The arrow found its mark
  9. 9

    come to believe on the basis of emotion, intuitions, or indefinite grounds

    find%2:31:10:: · find.v.05

    • I feel that he doesn't like me
    • I find him to be obnoxious

    Synonyms: feel

  10. 10

    decide on and make a declaration about

    find%2:32:01:: · rule.v.04

    • find someone guilty

    Synonyms: rule

  11. 11

    perceive or be contemporaneous with

    find%2:39:01:: · witness.v.02

    • We found Republicans winning the offices
    • You'll see a lot of cheating in this school

    Synonyms: witness, see

  12. 12

    accept and make use of one's personality, abilities, and situation

    find%2:30:13:: · find_oneself.v.01

    • My son went to Berkeley to find himself

    Synonyms: find oneself

  13. 13

    come upon, as if by accident; meet with

    find%2:40:02:: · find.v.01

    • We find this idea in Plato
    • I happened upon the most wonderful bakery not very far from here

    Synonyms: happen, chance, bump, encounter

  14. 14

    discover or determine the existence, presence, or fact of

    find%2:39:02:: · detect.v.01

    • She detected high levels of lead in her drinking water
    • We found traces of lead in the paint

    Synonyms: detect, observe, discover, notice

    Gold lexEN Gold Maru 2022 Gold Raganato
  15. 15

    come upon after searching; find the location of something that was missed or lost

    find%2:40:00:: · find.v.03

    • Did you find your glasses?
    • I cannot find my gloves!

    Synonyms: regain

    Selected
  16. 16

    make a discovery, make a new finding

    find%2:36:00:: · discover.v.03

    • Roentgen discovered X-rays
    • Physicists believe they found a new elementary particle

    Synonyms: discover