Verified run

Qwen/Qwen3.5-397B-A17B

vllm-qwen3.5-397b-a17b-gptq-b300-p001-lexen-v1-20260614

Rank
72
Accuracy lexEN v1 · WordNet fine
89.24%
Correct
4338 / 4861
Actual run cost
$0.766
Cost / M items
$157

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 89.24% 4338 / 4861 95.64% 4649 / 4861 93.31% 4536 / 4861
Maru 2022 (ALLamended) 87.14% 4236 / 4861 95.21% 4628 / 4861 92.22% 4483 / 4861
Raganato 2017 (original) 81.86% 3979 / 4861 92.72% 4507 / 4861 88.48% 4301 / 4861

Model

Display
Qwen/Qwen3.5-397B-A17B
Requested
hosted_vllm/Qwen/Qwen3.5-397B-A17B
Resolved
Qwen/Qwen3.5-397B-A17B
Vendor
Alibaba
API provider
n/a
Hosting
self_hosted
Source
open_source
License
apache-2.0
Reasoning
n/a
Model URL
https://huggingface.co/Qwen/Qwen3.5-397B-A17B
Endpoint
http://localhost:8000/v1
Resolved counts
Qwen/Qwen3.5-397B-A17B: 4861
HF revision
df333de344e06b492063d1ca04e2d4ee878f7595
Quantization
gptq-int4
Inference engine
vllm
Engine version
0.22.1
Container image
vllm/vllm-openai:v0.22.1
Serve command
exec vllm serve Qwen/Qwen3.5-397B-A17B-GPTQ-Int4 --port 8000 --served-model-name Qwen/Qwen3.5-397B-A17B --max-model-len 8192 --gpu-memory-utilization 0.90 --language-model-only --max-num-seqs 16 --gpu-memory-utilization 0.97 --trust-remote-code --default-chat-template-kwargs \{\"enable_thinking\":\ false\} --revision df333de344e06b492063d1ca04e2d4ee878f7595

Reproducibility

Created
2026-06-14T17:58:20.590182+00:00
Run schema
sensebench-run-v2
Commit
n/a
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p001
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
3,178,467
Tokens / item
653.9
Total cost
$0.766
Cost / M items
$157
Cost source
machine_time_estimate
Elapsed
6.84m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Machine & Timing

GPU
NVIDIA B300 SXM6 AC
VRAM / GPU
275,040 MiB
Driver
590.48.01
CUDA
13.1
CPU
Intel(R) Xeon(R) 6776P (256 cores)
RAM
3,023.5 GiB
Platform
Linux-6.8.0-117-generic-x86_64-with-glibc2.35
Provider
vast.ai (40919269)
Hourly rate
$6.72/h
Benchmark time
6.84m
Machine-hours / 1M items
23.4 h/M
Concurrency
64

Benchmark time covers only the per-item evaluation loop on this machine, excluding model and asset loading.

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
2,048
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.766. Cost estimate source: machine_time_estimate. Cost is estimated from machine time multiplied by the recorded hourly rate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 3,139,464 n/a n/a
Input cached n/a n/a n/a
Output 39,003 n/a n/a
Reasoning output n/a included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 84.76% 673 794
Candidate Count 2 94.39% 807 855
Candidate Count 3-5 89.92% 1749 1945
Candidate Count 6-10 87.53% 1109 1267
POS ADJ 91.20% 601 659
POS ADV 84.10% 164 195
POS NOUN 91.13% 2640 2897
POS VERB 84.05% 933 1110
Source Dataset semeval2013 93.07% 1061 1140
Source Dataset semeval2015 90.93% 672 739
Source Dataset senseval2 87.54% 1426 1629
Source Dataset senseval3 87.14% 1179 1353

Worst-Bucket Examples

affect Verb

Instance: semeval2015.d000.s009.t027 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

What is Alimta?

Alimta is a powder that is made up into a solution for infusion (drip into a vein).

It contains the active substance pemetrexed.

What is Alimta used for?

Alimta is used to treat two types of cancer: pleural mesothelioma (cancer of the lining of the lungs that is usually caused by exposure to asbestos).

Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread easily, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not affecting the squamous cells.

Alimta is used in combination with cisplatin in patients who have not been treated before, and on its own in patients who have received another type of chemotherapy in the past.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: affect
Target surface form: affecting
Context:
What is Alimta? Alimta is a powder that is made up into a solution for infusion (drip into a vein). It contains the active substance pemetrexed. What is Alimta used for? Alimta is used to treat two types of cancer: pleural mesothelioma (cancer of the lining of the lungs that is usually caused by exposure to asbestos). Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread easily, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not <t>affecting</t> the squamous cells. Alimta is used in combination with cisplatin in patients who have not been treated before, and on its own in patients who have received another type of chemotherapy in the past.

Candidate senses:
1. sense_key=affect%2:30:00:: | definition=have an effect upon | synonyms=impact, bear upon, bear on, touch on, touch | examples=Will the new rules affect me?
2. sense_key=affect%2:29:00:: | definition=act physically on; have an effect upon | examples=the medicine affects my heart rate
3. sense_key=affect%2:42:00:: | definition=connect closely and often incriminatingly | synonyms=involve, regard | examples=This new ruling affects your business
4. sense_key=affect%2:32:00:: | definition=make believe with the intent to deceive | synonyms=feign, sham, pretend, dissemble | examples=He feigned that he was ill; He shammed a headache
5. sense_key=affect%2:37:00:: | definition=have an emotional or cognitive impact upon | synonyms=impress, move, strike | examples=This child impressed me as unusually mature; This behavior struck me as odd

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    have an effect upon

    affect%2:30:00:: · affect.v.01

    • Will the new rules affect me?

    Synonyms: impact, bear upon, bear on, touch on, touch

    Selected
  2. 2

    act physically on; have an effect upon

    affect%2:29:00:: · affect.v.02

    • the medicine affects my heart rate
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    connect closely and often incriminatingly

    affect%2:42:00:: · involve.v.01

    • This new ruling affects your business

    Synonyms: involve, regard

  4. 4

    make believe with the intent to deceive

    affect%2:32:00:: · feign.v.01

    • He feigned that he was ill
    • He shammed a headache

    Synonyms: feign, sham, pretend, dissemble

  5. 5

    have an emotional or cognitive impact upon

    affect%2:37:00:: · affect.v.05

    • This child impressed me as unusually mature
    • This behavior struck me as odd

    Synonyms: impress, move, strike

prevent Verb

Instance: semeval2015.d000.s017.t002 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

How is Alimta used?

Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy.

The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight).

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta.

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: prevent
Target surface form: prevent
Context:
How is Alimta used? Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy. The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight). It is given once every three weeks as an intravenous infusion lasting 10 minutes. To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta. When Alimta is given with cisplatin, an anti-emetic medicine (to <t>prevent</t> vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Candidate senses:
1. sense_key=prevent%2:41:01:: | definition=keep from happening or arising; make impossible | synonyms=forestall, foreclose, preclude, forbid | examples=My sense of tact forbids an honest answer; Your role in the projects precludes your involvement in the competitive project
2. sense_key=prevent%2:41:00:: | definition=stop (someone or something) from doing something or being in a certain state | synonyms=keep | examples=We must prevent the cancer from spreading; His snoring kept me from falling asleep

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    keep from happening or arising; make impossible

    prevent%2:41:01:: · prevent.v.01

    • My sense of tact forbids an honest answer
    • Your role in the projects precludes your involvement in the competitive project

    Synonyms: forestall, foreclose, preclude, forbid

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    stop (someone or something) from doing something or being in a certain state

    prevent%2:41:00:: · prevent.v.02

    • We must prevent the cancer from spreading
    • His snoring kept me from falling asleep

    Synonyms: keep

    Gold Raganato Selected

have Verb

Instance: semeval2015.d000.s018.t008 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy.

The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight).

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta.

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: have
Target surface form: have
Context:
Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy. The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight). It is given once every three weeks as an intravenous infusion lasting 10 minutes. To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta. When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who <t>have</t> certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems.

Candidate senses:
1. sense_key=have%2:40:00:: | definition=have or possess, either in a concrete or an abstract sense | synonyms=have got, hold | examples=She has $1,000 in the bank; He has got two beautiful daughters
2. sense_key=have%2:42:00:: | definition=have as a feature | synonyms=feature | examples=This restaurant features the most famous chefs in France
3. sense_key=have%2:39:06:: | definition=go through (mental or physical states or experiences) | synonyms=experience, receive, get | examples=get an idea; experience vertigo
4. sense_key=have%2:40:04:: | definition=have ownership or possession of | synonyms=own, possess | examples=He owns three houses in Florida; How many cars does she have?
5. sense_key=have%2:30:00:: | definition=cause to move; cause to be in a certain position or condition | synonyms=get, let | examples=He got his squad on the ball; This let me in for a big surprise
6. sense_key=have%2:34:00:: | definition=serve oneself to, or consume regularly | synonyms=consume, ingest, take in, take | examples=Have another bowl of chicken soup!; I don't take sugar in my coffee
7. sense_key=have%2:41:00:: | definition=have a personal or business relationship with someone | examples=have a postdoc; have an assistant
8. sense_key=have%2:36:00:: | definition=organize or be responsible for | synonyms=hold, throw, make, give | examples=hold a reception; have, throw, or make a party
9. sense_key=have%2:40:01:: | definition=have left | examples=I have two years left; I don't have any money left
10. sense_key=have%2:42:12:: | definition=be confronted with | examples=What do we have here?; Now we have a fine mess
11. sense_key=have%2:30:01:: | definition=undergo | synonyms=experience | examples=The stocks had a fast run-up
12. sense_key=have%2:29:02:: | definition=suffer from; be ill with | examples=She has arthritis
13. sense_key=have%2:32:00:: | definition=cause to do; cause to act in a specified manner | synonyms=induce, stimulate, cause, get, make | examples=The ads induced me to buy a VCR; My children finally got me to buy a computer
14. sense_key=have%2:40:05:: | definition=receive willingly something given or offered | synonyms=accept, take | examples=The only girl who would have him was the miller's daughter; I won't have this dog in my house!
15. sense_key=have%2:40:03:: | definition=get something; come into possession of | synonyms=receive | examples=receive payment; receive a gift
16. sense_key=have%2:29:05:: | definition=undergo (as of injuries and illnesses) | synonyms=suffer, sustain, get | examples=She suffered a fracture in the accident; He had an insulin shock after eating three candy bars
17. sense_key=have%2:40:02:: | definition=achieve a point or goal | synonyms=get, make | examples=Nicklaus had a 70; The Brazilian team got 4 goals
18. sense_key=have%2:29:00:: | definition=cause to be born | synonyms=give birth, deliver, bear, birth | examples=My wife had twins yesterday!
19. sense_key=have%2:35:00:: | definition=have sex with; archaic use | synonyms=take | examples=He had taken this woman when she was most vulnerable

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    have or possess, either in a concrete or an abstract sense

    have%2:40:00:: · have.v.01

    • She has $1,000 in the bank
    • He has got two beautiful daughters

    Synonyms: have got, hold

  2. 2

    have as a feature

    have%2:42:00:: · have.v.02

    • This restaurant features the most famous chefs in France

    Synonyms: feature

  3. 3

    go through (mental or physical states or experiences)

    have%2:39:06:: · experience.v.03

    • get an idea
    • experience vertigo

    Synonyms: experience, receive, get

    Gold lexEN Gold Maru 2022
  4. 4

    have ownership or possession of

    have%2:40:04:: · own.v.01

    • He owns three houses in Florida
    • How many cars does she have?

    Synonyms: own, possess

  5. 5

    cause to move; cause to be in a certain position or condition

    have%2:30:00:: · get.v.03

    • He got his squad on the ball
    • This let me in for a big surprise

    Synonyms: get, let

  6. 6

    serve oneself to, or consume regularly

    have%2:34:00:: · consume.v.02

    • Have another bowl of chicken soup!
    • I don't take sugar in my coffee

    Synonyms: consume, ingest, take in, take

  7. 7

    have a personal or business relationship with someone

    have%2:41:00:: · have.v.07

    • have a postdoc
    • have an assistant
  8. 8

    organize or be responsible for

    have%2:36:00:: · hold.v.03

    • hold a reception
    • have, throw, or make a party

    Synonyms: hold, throw, make, give

  9. 9

    have left

    have%2:40:01:: · have.v.09

    • I have two years left
    • I don't have any money left
  10. 10

    be confronted with

    have%2:42:12:: · have.v.10

    • What do we have here?
    • Now we have a fine mess
  11. 11

    undergo

    have%2:30:01:: · have.v.11

    • The stocks had a fast run-up

    Synonyms: experience

    Gold lexEN Gold Maru 2022
  12. 12

    suffer from; be ill with

    have%2:29:02:: · have.v.12

    • She has arthritis
    Gold Raganato Selected
  13. 13

    cause to do; cause to act in a specified manner

    have%2:32:00:: · induce.v.02

    • The ads induced me to buy a VCR
    • My children finally got me to buy a computer

    Synonyms: induce, stimulate, cause, get, make

  14. 14

    receive willingly something given or offered

    have%2:40:05:: · accept.v.02

    • The only girl who would have him was the miller's daughter
    • I won't have this dog in my house!

    Synonyms: accept, take

  15. 15

    get something; come into possession of

    have%2:40:03:: · receive.v.01

    • receive payment
    • receive a gift

    Synonyms: receive

  16. 16

    undergo (as of injuries and illnesses)

    have%2:29:05:: · suffer.v.02

    • She suffered a fracture in the accident
    • He had an insulin shock after eating three candy bars

    Synonyms: suffer, sustain, get

    Gold Raganato
  17. 17

    achieve a point or goal

    have%2:40:02:: · have.v.17

    • Nicklaus had a 70
    • The Brazilian team got 4 goals

    Synonyms: get, make

  18. 18

    cause to be born

    have%2:29:00:: · give_birth.v.01

    • My wife had twins yesterday!

    Synonyms: give birth, deliver, bear, birth

  19. 19

    have sex with; archaic use

    have%2:35:00:: · take.v.35

    • He had taken this woman when she was most vulnerable

    Synonyms: take

see Verb

Instance: semeval2015.d000.s020.t002 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta.

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: see
Target surface form: see
Context:
It is given once every three weeks as an intravenous infusion lasting 10 minutes. To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta. When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, <t>see</t> the Summary of Product Characteristics (also part of the EPAR). How does Alimta work?

Candidate senses:
1. sense_key=see%2:39:00:: | definition=perceive by sight or have the power to perceive by sight | examples=You have to be a good observer to see all the details; Can you see the bird in that tree?
2. sense_key=see%2:31:01:: | definition=perceive (an idea or situation) mentally | synonyms=understand, realize, realise | examples=Now I see!; I just can't see your point
3. sense_key=see%2:39:02:: | definition=perceive or be contemporaneous with | synonyms=witness, find | examples=We found Republicans winning the offices; You'll see a lot of cheating in this school
4. sense_key=see%2:36:00:: | definition=imagine; conceive of; see in one's mind | synonyms=visualize, visualise, envision, project, fancy, figure | examples=I can't see him on horseback!; I can see what will happen
5. sense_key=see%2:31:00:: | definition=deem to be | synonyms=consider, reckon, view, regard | examples=She views this quite differently from me; I consider her to be shallow
6. sense_key=see%2:31:02:: | definition=get to know or become aware of, usually accidentally | synonyms=learn, hear, get word, get wind, pick up, find out | examples=I learned that she has two grown-up children; I see that you have been promoted
7. sense_key=see%2:39:03:: | definition=see or watch | synonyms=watch, view, catch, take in | examples=view a show on television; This program will be seen all over the world
8. sense_key=see%2:38:00:: | definition=come together | synonyms=meet, run into, encounter, run across, come across | examples=I'll probably see you at the meeting; How nice to see you again!
9. sense_key=see%2:32:00:: | definition=find out, learn, or determine with certainty, usually by making an inquiry or other effort | synonyms=determine, check, find out, ascertain, watch, learn | examples=I want to see whether she speaks French; See whether it works
10. sense_key=see%2:31:03:: | definition=be careful or certain to do something; make certain of something | synonyms=check, insure, see to it, ensure, control, ascertain | examples=He verified that the valves were closed; See that the curtains are closed
11. sense_key=see%2:41:11:: | definition=go to see for professional or business reasons | examples=You should see a lawyer; We had to see a psychiatrist
12. sense_key=see%2:41:12:: | definition=go to see for a social visit | examples=I went to see my friend Mary the other day
13. sense_key=see%2:41:10:: | definition=go to see a place, as for entertainment | synonyms=visit | examples=We went to see the Eiffel Tower in the morning
14. sense_key=see%2:41:14:: | definition=take charge of or deal with | synonyms=attend, take care, look | examples=Could you see about lunch?; I must attend to this matter
15. sense_key=see%2:35:09:: | definition=receive as a specified guest | examples=the doctor will see you now; The minister doesn't see anybody before noon
16. sense_key=see%2:41:00:: | definition=date regularly; have a steady relationship with | synonyms=go steady, go out, date | examples=Did you know that she is seeing an older man?; He is dating his former wife again!
17. sense_key=see%2:39:05:: | definition=see and understand, have a good eye | examples=The artist must first learn to see
18. sense_key=see%2:31:08:: | definition=deliberate or decide | examples=See whether you can come tomorrow; let's see--which movie should we see tonight?
19. sense_key=see%2:39:11:: | definition=observe as if with an eye | examples=The camera saw the burglary and recorded it
20. sense_key=see%2:39:13:: | definition=observe, check out, and look over carefully or inspect | synonyms=examine | examples=The customs agent examined the baggage; I must see your passport before you can enter the country
21. sense_key=see%2:39:12:: | definition=go or live through | synonyms=experience, go through | examples=We had many trials to go through; he saw action in Viet Nam
22. sense_key=see%2:38:03:: | definition=accompany or escort | synonyms=escort | examples=I'll see you to the door
23. sense_key=see%2:33:00:: | definition=match or meet | examples=I saw the bet of one of my fellow players
24. sense_key=see%2:31:13:: | definition=make sense of; assign a meaning to | synonyms=interpret, construe | examples=What message do you see in this letter?; How do you interpret his behavior?

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    perceive by sight or have the power to perceive by sight

    see%2:39:00:: · see.v.01

    • You have to be a good observer to see all the details
    • Can you see the bird in that tree?
  2. 2

    perceive (an idea or situation) mentally

    see%2:31:01:: · understand.v.02

    • Now I see!
    • I just can't see your point

    Synonyms: understand, realize, realise

  3. 3

    perceive or be contemporaneous with

    see%2:39:02:: · witness.v.02

    • We found Republicans winning the offices
    • You'll see a lot of cheating in this school

    Synonyms: witness, find

  4. 4

    imagine; conceive of; see in one's mind

    see%2:36:00:: · visualize.v.01

    • I can't see him on horseback!
    • I can see what will happen

    Synonyms: visualize, visualise, envision, project, fancy, figure, picture, image

  5. 5

    deem to be

    see%2:31:00:: · see.v.05

    • She views this quite differently from me
    • I consider her to be shallow

    Synonyms: consider, reckon, view, regard

  6. 6

    get to know or become aware of, usually accidentally

    see%2:31:02:: · learn.v.02

    • I learned that she has two grown-up children
    • I see that you have been promoted

    Synonyms: learn, hear, get word, get wind, pick up, find out, get a line, discover

  7. 7

    see or watch

    see%2:39:03:: · watch.v.03

    • view a show on television
    • This program will be seen all over the world

    Synonyms: watch, view, catch, take in

  8. 8

    come together

    see%2:38:00:: · meet.v.01

    • I'll probably see you at the meeting
    • How nice to see you again!

    Synonyms: meet, run into, encounter, run across, come across

  9. 9

    find out, learn, or determine with certainty, usually by making an inquiry or other effort

    see%2:32:00:: · determine.v.08

    • I want to see whether she speaks French
    • See whether it works

    Synonyms: determine, check, find out, ascertain, watch, learn

    Selected
  10. 10

    be careful or certain to do something; make certain of something

    see%2:31:03:: · see.v.10

    • He verified that the valves were closed
    • See that the curtains are closed

    Synonyms: check, insure, see to it, ensure, control, ascertain, assure

  11. 11

    go to see for professional or business reasons

    see%2:41:11:: · see.v.11

    • You should see a lawyer
    • We had to see a psychiatrist
  12. 12

    go to see for a social visit

    see%2:41:12:: · see.v.12

    • I went to see my friend Mary the other day
  13. 13

    go to see a place, as for entertainment

    see%2:41:10:: · visit.v.01

    • We went to see the Eiffel Tower in the morning

    Synonyms: visit

  14. 14

    take charge of or deal with

    see%2:41:14:: · attend.v.02

    • Could you see about lunch?
    • I must attend to this matter

    Synonyms: attend, take care, look

  15. 15

    receive as a specified guest

    see%2:35:09:: · see.v.15

    • the doctor will see you now
    • The minister doesn't see anybody before noon
  16. 16

    date regularly; have a steady relationship with

    see%2:41:00:: · go_steady.v.01

    • Did you know that she is seeing an older man?
    • He is dating his former wife again!

    Synonyms: go steady, go out, date

  17. 17

    see and understand, have a good eye

    see%2:39:05:: · see.v.17

    • The artist must first learn to see
  18. 18

    deliberate or decide

    see%2:31:08:: · see.v.18

    • See whether you can come tomorrow
    • let's see--which movie should we see tonight?
  19. 19

    observe as if with an eye

    see%2:39:11:: · see.v.19

    • The camera saw the burglary and recorded it
  20. 20

    observe, check out, and look over carefully or inspect

    see%2:39:13:: · examine.v.02

    • The customs agent examined the baggage
    • I must see your passport before you can enter the country

    Synonyms: examine

    Gold lexEN Gold Maru 2022 Gold Raganato
  21. 21

    go or live through

    see%2:39:12:: · experience.v.01

    • We had many trials to go through
    • he saw action in Viet Nam

    Synonyms: experience, go through

  22. 22

    accompany or escort

    see%2:38:03:: · see.v.22

    • I'll see you to the door

    Synonyms: escort

  23. 23

    match or meet

    see%2:33:00:: · see.v.23

    • I saw the bet of one of my fellow players
  24. 24

    make sense of; assign a meaning to

    see%2:31:13:: · interpret.v.01

    • What message do you see in this letter?
    • How do you interpret his behavior?

    Synonyms: interpret, construe

kill Verb

Instance: semeval2015.d000.s022.t005 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: kill
Target surface form: kills
Context:
When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that <t>kills</t> cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Candidate senses:
1. sense_key=kill%2:35:00:: | definition=cause to die; put to death, usually intentionally or knowingly | examples=This man killed several people when he tried to rob a bank; The farmer killed a pig for the holidays
2. sense_key=kill%2:41:01:: | definition=thwart the passage of | synonyms=shoot down, defeat, vote down, vote out | examples=kill a motion; he shot down the student's proposal
3. sense_key=kill%2:30:08:: | definition=end or extinguish by forceful means | synonyms=stamp out | examples=Stamp out poverty!
4. sense_key=kill%2:42:00:: | definition=be fatal | examples=cigarettes kill; drunken driving kills
5. sense_key=kill%2:39:00:: | definition=be the source of great pain for | examples=These new shoes are killing me!
6. sense_key=kill%2:37:00:: | definition=overwhelm with hilarity, pleasure, or admiration | examples=The comedian was so funny, he was killing me!
7. sense_key=kill%2:35:06:: | definition=hit with so much force as to make a return impossible, in racket games | examples=She killed the ball
8. sense_key=kill%2:35:05:: | definition=hit with great force | examples=He killed the ball
9. sense_key=kill%2:35:02:: | definition=deprive of life | examples=AIDS has killed thousands in Africa
10. sense_key=kill%2:35:01:: | definition=cause the death of, without intention | examples=She was killed in the collision of three cars
11. sense_key=kill%2:34:00:: | definition=drink down entirely | synonyms=toss off, pop, bolt down, belt down, pour down, down | examples=He downed three martinis before dinner; She killed a bottle of brandy that night
12. sense_key=kill%2:30:00:: | definition=mark for deletion, rub off, or erase | synonyms=obliterate, wipe out | examples=kill these lines in the President's speech
13. sense_key=kill%2:30:04:: | definition=tire out completely | examples=The daily stress of her work is killing her
14. sense_key=kill%2:30:03:: | definition=cause to cease operating | examples=kill the engine
15. sense_key=kill%2:30:02:: | definition=destroy a vitally essential quality of or in | examples=Eating artichokes kills the taste of all other foods

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    cause to die; put to death, usually intentionally or knowingly

    kill%2:35:00:: · kill.v.01

    • This man killed several people when he tried to rob a bank
    • The farmer killed a pig for the holidays
    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    thwart the passage of

    kill%2:41:01:: · kill.v.02

    • kill a motion
    • he shot down the student's proposal

    Synonyms: shoot down, defeat, vote down, vote out

    Selected
  3. 3

    end or extinguish by forceful means

    kill%2:30:08:: · stamp_out.v.01

    • Stamp out poverty!

    Synonyms: stamp out

  4. 4

    be fatal

    kill%2:42:00:: · kill.v.04

    • cigarettes kill
    • drunken driving kills
  5. 5

    be the source of great pain for

    kill%2:39:00:: · kill.v.05

    • These new shoes are killing me!
  6. 6

    overwhelm with hilarity, pleasure, or admiration

    kill%2:37:00:: · kill.v.06

    • The comedian was so funny, he was killing me!
  7. 7

    hit with so much force as to make a return impossible, in racket games

    kill%2:35:06:: · kill.v.07

    • She killed the ball
  8. 8

    hit with great force

    kill%2:35:05:: · kill.v.08

    • He killed the ball
  9. 9

    deprive of life

    kill%2:35:02:: · kill.v.09

    • AIDS has killed thousands in Africa
    Gold lexEN Gold Maru 2022
  10. 10

    cause the death of, without intention

    kill%2:35:01:: · kill.v.10

    • She was killed in the collision of three cars
    Gold lexEN Gold Maru 2022
  11. 11

    drink down entirely

    kill%2:34:00:: · toss_off.v.02

    • He downed three martinis before dinner
    • She killed a bottle of brandy that night

    Synonyms: toss off, pop, bolt down, belt down, pour down, down, drink down

  12. 12

    mark for deletion, rub off, or erase

    kill%2:30:00:: · kill.v.12

    • kill these lines in the President's speech

    Synonyms: obliterate, wipe out

  13. 13

    tire out completely

    kill%2:30:04:: · kill.v.13

    • The daily stress of her work is killing her
  14. 14

    cause to cease operating

    kill%2:30:03:: · kill.v.14

    • kill the engine
  15. 15

    destroy a vitally essential quality of or in

    kill%2:30:02:: · kill.v.15

    • Eating artichokes kills the taste of all other foods

convert Verb

Instance: semeval2015.d000.s023.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: convert
Target surface form: converted
Context:
Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is <t>converted</t> into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied?

Candidate senses:
1. sense_key=convert%2:30:00:: | definition=change from one system to another or to a new plan or policy | synonyms=change over | examples=We converted from 220 to 110 Volt
2. sense_key=convert%2:30:03:: | definition=change the nature, purpose, or function of something | examples=convert lead into gold; convert hotels into jails
3. sense_key=convert%2:30:01:: | definition=change religious beliefs, or adopt a religious belief | examples=She converted to Buddhism
4. sense_key=convert%2:30:02:: | definition=exchange or replace with another, usually of the same kind or category | synonyms=change, exchange, commute | examples=Could you convert my dollars into pounds?; He changed his name
5. sense_key=convert%2:30:07:: | definition=cause to adopt a new or different faith | examples=The missionaries converted the Indian population
6. sense_key=convert%2:33:02:: | definition=score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone | examples=Smith converted and his team won
7. sense_key=convert%2:33:01:: | definition=complete successfully | examples=score a penalty shot or free throw
8. sense_key=convert%2:33:00:: | definition=score (a spare)
9. sense_key=convert%2:32:00:: | definition=make (someone) agree, understand, or realize the truth or validity of something | synonyms=win over, convince | examples=He had finally convinced several customers of the advantages of his product
10. sense_key=convert%2:30:09:: | definition=exchange a penalty for a less severe one | synonyms=commute, exchange
11. sense_key=convert%2:30:04:: | definition=change in nature, purpose, or function; undergo a chemical change | examples=The substance converts to an acid

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    change from one system to another or to a new plan or policy

    convert%2:30:00:: · convert.v.01

    • We converted from 220 to 110 Volt

    Synonyms: change over

  2. 2

    change the nature, purpose, or function of something

    convert%2:30:03:: · convert.v.02

    • convert lead into gold
    • convert hotels into jails
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    change religious beliefs, or adopt a religious belief

    convert%2:30:01:: · convert.v.03

    • She converted to Buddhism
  4. 4

    exchange or replace with another, usually of the same kind or category

    convert%2:30:02:: · change.v.06

    • Could you convert my dollars into pounds?
    • He changed his name

    Synonyms: change, exchange, commute

  5. 5

    cause to adopt a new or different faith

    convert%2:30:07:: · convert.v.05

    • The missionaries converted the Indian population
  6. 6

    score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone

    convert%2:33:02:: · convert.v.06

    • Smith converted and his team won
  7. 7

    complete successfully

    convert%2:33:01:: · convert.v.07

    • score a penalty shot or free throw
  8. 8

    score (a spare)

    convert%2:33:00:: · convert.v.08

  9. 9

    make (someone) agree, understand, or realize the truth or validity of something

    convert%2:32:00:: · convert.v.09

    • He had finally convinced several customers of the advantages of his product

    Synonyms: win over, convince

  10. 10

    exchange a penalty for a less severe one

    convert%2:30:09:: · commute.v.04

    Synonyms: commute, exchange

  11. 11

    change in nature, purpose, or function; undergo a chemical change

    convert%2:30:04:: · convert.v.11

    • The substance converts to an acid
    Gold Raganato Selected

involve Verb

Instance: semeval2015.d000.s028.t006 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before.

The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone.

For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

In all three studies, the main measure of effectiveness was how long the patients survived.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: involve
Target surface form: involving
Context:
In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied? For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before. The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone. For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past. Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study <t>involving</t> 1,725 patients who had not received chemotherapy for lung cancer in the past. In all three studies, the main measure of effectiveness was how long the patients survived.

Candidate senses:
1. sense_key=involve%2:42:01:: | definition=connect closely and often incriminatingly | synonyms=affect, regard | examples=This new ruling affects your business
2. sense_key=involve%2:42:04:: | definition=engage as a participant | examples=Don't involve me in your family affairs!
3. sense_key=involve%2:42:00:: | definition=have as a necessary feature | synonyms=imply | examples=This decision involves many changes
4. sense_key=involve%2:42:07:: | definition=require as useful, just, or proper | synonyms=necessitate, ask, postulate, need, require, take | examples=It takes nerve to do what she did; success usually requires hard work
5. sense_key=involve%2:42:02:: | definition=contain as a part | examples=Dinner at Joe's always involves at least six courses
6. sense_key=involve%2:31:00:: | definition=occupy or engage the interest of | examples=His story completely involved me during the entire afternoon
7. sense_key=involve%2:30:00:: | definition=make complex or intricate or complicated | examples=The situation was rather involved

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    connect closely and often incriminatingly

    involve%2:42:01:: · involve.v.01

    • This new ruling affects your business

    Synonyms: affect, regard

  2. 2

    engage as a participant

    involve%2:42:04:: · involve.v.02

    • Don't involve me in your family affairs!
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    have as a necessary feature

    involve%2:42:00:: · imply.v.05

    • This decision involves many changes

    Synonyms: imply

  4. 4

    require as useful, just, or proper

    involve%2:42:07:: · necessitate.v.01

    • It takes nerve to do what she did
    • success usually requires hard work

    Synonyms: necessitate, ask, postulate, need, require, take, call for, demand

  5. 5

    contain as a part

    involve%2:42:02:: · involve.v.05

    • Dinner at Joe's always involves at least six courses
    Selected
  6. 6

    occupy or engage the interest of

    involve%2:31:00:: · involve.v.06

    • His story completely involved me during the entire afternoon
  7. 7

    make complex or intricate or complicated

    involve%2:30:00:: · involve.v.07

    • The situation was rather involved

survive Verb

Instance: semeval2015.d000.s029.t006 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

How has Alimta been studied?

For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before.

The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone.

For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

In all three studies, the main measure of effectiveness was how long the patients survived.

What benefit has Alimta shown during the studies?

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: survive
Target surface form: survived
Context:
How has Alimta been studied? For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before. The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone. For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past. Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past. In all three studies, the main measure of effectiveness was how long the patients <t>survived</t>. What benefit has Alimta shown during the studies?

Candidate senses:
1. sense_key=survive%2:42:01:: | definition=continue to live through hardship or adversity | synonyms=last, live, live on, go, endure, hold up | examples=We went without water and food for 3 days; These superstitions survive in the backwaters of America
2. sense_key=survive%2:42:02:: | definition=continue in existence after (an adversity, etc.) | synonyms=pull through, pull round, come through, make it | examples=He survived the cancer against all odds
3. sense_key=survive%2:42:00:: | definition=support oneself | synonyms=exist, live, subsist | examples=he could barely exist on such a low wage; Can you live on $2000 a month in New York City?
4. sense_key=survive%2:42:03:: | definition=live longer than | synonyms=outlive, outlast | examples=She outlived her husband by many years

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    continue to live through hardship or adversity

    survive%2:42:01:: · survive.v.01

    • We went without water and food for 3 days
    • These superstitions survive in the backwaters of America

    Synonyms: last, live, live on, go, endure, hold up, hold out

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    continue in existence after (an adversity, etc.)

    survive%2:42:02:: · survive.v.02

    • He survived the cancer against all odds

    Synonyms: pull through, pull round, come through, make it

    Gold Raganato Selected
  3. 3

    support oneself

    survive%2:42:00:: · exist.v.02

    • he could barely exist on such a low wage
    • Can you live on $2000 a month in New York City?

    Synonyms: exist, live, subsist

  4. 4

    live longer than

    survive%2:42:03:: · outlive.v.01

    • She outlived her husband by many years

    Synonyms: outlive, outlast

affect Verb

Instance: semeval2015.d000.s036.t005 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Alimta increased the survival time of patients with malignant pleural mesothelioma.

Patients receiving Alimta and cisplatin survived for an average of 12.1 months, compared with 9.3 months in those receiving cisplatin alone.

In the treatment of patients with non-small cell lung cancer, Alimta was as effective as the comparators.

In patients who had received chemotherapy in the past, the average survival time was 8.3 months with Alimta, compared with 7.9 months with docetaxel.

In patients who had not received chemotherapy in the past, the average survival time was 10.3 months in both groups.

However, in both studies, patients whose cancer was not affecting squamous cells had longer survival times if they received Alimta than if they received the comparator.

In contrast, patients whose cancer was affecting squamous cells had shorter survival times if they received Alimta.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: affect
Target surface form: affecting
Context:
Alimta increased the survival time of patients with malignant pleural mesothelioma. Patients receiving Alimta and cisplatin survived for an average of 12.1 months, compared with 9.3 months in those receiving cisplatin alone. In the treatment of patients with non-small cell lung cancer, Alimta was as effective as the comparators. In patients who had received chemotherapy in the past, the average survival time was 8.3 months with Alimta, compared with 7.9 months with docetaxel. In patients who had not received chemotherapy in the past, the average survival time was 10.3 months in both groups. However, in both studies, patients whose cancer was not <t>affecting</t> squamous cells had longer survival times if they received Alimta than if they received the comparator. In contrast, patients whose cancer was affecting squamous cells had shorter survival times if they received Alimta.

Candidate senses:
1. sense_key=affect%2:30:00:: | definition=have an effect upon | synonyms=impact, bear upon, bear on, touch on, touch | examples=Will the new rules affect me?
2. sense_key=affect%2:29:00:: | definition=act physically on; have an effect upon | examples=the medicine affects my heart rate
3. sense_key=affect%2:42:00:: | definition=connect closely and often incriminatingly | synonyms=involve, regard | examples=This new ruling affects your business
4. sense_key=affect%2:32:00:: | definition=make believe with the intent to deceive | synonyms=feign, sham, pretend, dissemble | examples=He feigned that he was ill; He shammed a headache
5. sense_key=affect%2:37:00:: | definition=have an emotional or cognitive impact upon | synonyms=impress, move, strike | examples=This child impressed me as unusually mature; This behavior struck me as odd

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    have an effect upon

    affect%2:30:00:: · affect.v.01

    • Will the new rules affect me?

    Synonyms: impact, bear upon, bear on, touch on, touch

    Selected
  2. 2

    act physically on; have an effect upon

    affect%2:29:00:: · affect.v.02

    • the medicine affects my heart rate
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    connect closely and often incriminatingly

    affect%2:42:00:: · involve.v.01

    • This new ruling affects your business

    Synonyms: involve, regard

  4. 4

    make believe with the intent to deceive

    affect%2:32:00:: · feign.v.01

    • He feigned that he was ill
    • He shammed a headache

    Synonyms: feign, sham, pretend, dissemble

  5. 5

    have an emotional or cognitive impact upon

    affect%2:37:00:: · affect.v.05

    • This child impressed me as unusually mature
    • This behavior struck me as odd

    Synonyms: impress, move, strike

affect Verb

Instance: semeval2015.d000.s037.t003 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Patients receiving Alimta and cisplatin survived for an average of 12.1 months, compared with 9.3 months in those receiving cisplatin alone.

In the treatment of patients with non-small cell lung cancer, Alimta was as effective as the comparators.

In patients who had received chemotherapy in the past, the average survival time was 8.3 months with Alimta, compared with 7.9 months with docetaxel.

In patients who had not received chemotherapy in the past, the average survival time was 10.3 months in both groups.

However, in both studies, patients whose cancer was not affecting squamous cells had longer survival times if they received Alimta than if they received the comparator.

In contrast, patients whose cancer was affecting squamous cells had shorter survival times if they received Alimta.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: affect
Target surface form: affecting
Context:
Patients receiving Alimta and cisplatin survived for an average of 12.1 months, compared with 9.3 months in those receiving cisplatin alone. In the treatment of patients with non-small cell lung cancer, Alimta was as effective as the comparators. In patients who had received chemotherapy in the past, the average survival time was 8.3 months with Alimta, compared with 7.9 months with docetaxel. In patients who had not received chemotherapy in the past, the average survival time was 10.3 months in both groups. However, in both studies, patients whose cancer was not affecting squamous cells had longer survival times if they received Alimta than if they received the comparator. In contrast, patients whose cancer was <t>affecting</t> squamous cells had shorter survival times if they received Alimta.

Candidate senses:
1. sense_key=affect%2:30:00:: | definition=have an effect upon | synonyms=impact, bear upon, bear on, touch on, touch | examples=Will the new rules affect me?
2. sense_key=affect%2:29:00:: | definition=act physically on; have an effect upon | examples=the medicine affects my heart rate
3. sense_key=affect%2:42:00:: | definition=connect closely and often incriminatingly | synonyms=involve, regard | examples=This new ruling affects your business
4. sense_key=affect%2:32:00:: | definition=make believe with the intent to deceive | synonyms=feign, sham, pretend, dissemble | examples=He feigned that he was ill; He shammed a headache
5. sense_key=affect%2:37:00:: | definition=have an emotional or cognitive impact upon | synonyms=impress, move, strike | examples=This child impressed me as unusually mature; This behavior struck me as odd

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    have an effect upon

    affect%2:30:00:: · affect.v.01

    • Will the new rules affect me?

    Synonyms: impact, bear upon, bear on, touch on, touch

    Selected
  2. 2

    act physically on; have an effect upon

    affect%2:29:00:: · affect.v.02

    • the medicine affects my heart rate
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    connect closely and often incriminatingly

    affect%2:42:00:: · involve.v.01

    • This new ruling affects your business

    Synonyms: involve, regard

  4. 4

    make believe with the intent to deceive

    affect%2:32:00:: · feign.v.01

    • He feigned that he was ill
    • He shammed a headache

    Synonyms: feign, sham, pretend, dissemble

  5. 5

    have an emotional or cognitive impact upon

    affect%2:37:00:: · affect.v.05

    • This child impressed me as unusually mature
    • This behavior struck me as odd

    Synonyms: impress, move, strike

find Verb

Instance: semeval2015.d001.s008.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

kalgebra is a MathML based graph calculator.

Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge.

Here's a screenshot of kalgebra main window

kalgebra main window

kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab.

Below these tabs you will find an input field to type your functions or do your calculations.

If we want to understand how it works, the best thing we can do is to realize that our input is being converted into MathML although it is not necessary to know MathML.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: find
Target surface form: find
Context:
kalgebra is a MathML based graph calculator. Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge. Here's a screenshot of kalgebra main window kalgebra main window kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab. Below these tabs you will <t>find</t> an input field to type your functions or do your calculations. If we want to understand how it works, the best thing we can do is to realize that our input is being converted into MathML although it is not necessary to know MathML.

Candidate senses:
1. sense_key=find%2:40:02:: | definition=come upon, as if by accident; meet with | synonyms=happen, chance, bump, encounter | examples=We find this idea in Plato; I happened upon the most wonderful bakery not very far from here
2. sense_key=find%2:39:02:: | definition=discover or determine the existence, presence, or fact of | synonyms=detect, observe, discover, notice | examples=She detected high levels of lead in her drinking water; We found traces of lead in the paint
3. sense_key=find%2:40:00:: | definition=come upon after searching; find the location of something that was missed or lost | synonyms=regain | examples=Did you find your glasses?; I cannot find my gloves!
4. sense_key=find%2:32:00:: | definition=establish after a calculation, investigation, experiment, survey, or study | synonyms=determine, find out, ascertain | examples=find the product of two numbers; The physicist who found the elusive particle won the Nobel Prize
5. sense_key=find%2:31:10:: | definition=come to believe on the basis of emotion, intuitions, or indefinite grounds | synonyms=feel | examples=I feel that he doesn't like me; I find him to be obnoxious
6. sense_key=find%2:39:01:: | definition=perceive or be contemporaneous with | synonyms=witness, see | examples=We found Republicans winning the offices; You'll see a lot of cheating in this school
7. sense_key=find%2:40:01:: | definition=get something or somebody for a specific purpose | synonyms=line up, get hold, come up | examples=I found this gadget that will serve as a bottle opener; I got hold of these tools to fix our plumbing
8. sense_key=find%2:36:00:: | definition=make a discovery, make a new finding | synonyms=discover | examples=Roentgen discovered X-rays; Physicists believe they found a new elementary particle
9. sense_key=find%2:31:09:: | definition=make a discovery | synonyms=discover | examples=She found that he had lied to her; The story is false, so far as I can discover
10. sense_key=find%2:40:03:: | definition=obtain through effort or management | examples=She found the time and energy to take care of her aging parents; We found the money to send our sons to college
11. sense_key=find%2:32:01:: | definition=decide on and make a declaration about | synonyms=rule | examples=find someone guilty
12. sense_key=find%2:30:00:: | definition=receive a specified treatment (abstract) | synonyms=receive, get, obtain, incur | examples=These aspects of civilization do not find expression or receive an interpretation; His movie received a good review
13. sense_key=find%2:39:05:: | definition=perceive oneself to be in a certain condition or place | examples=I found myself in a difficult situation; When he woke up, he found himself in a hospital room
14. sense_key=find%2:40:15:: | definition=get or find back; recover the use of | synonyms=recover, retrieve, regain | examples=She regained control of herself; She found her voice and replied quickly
15. sense_key=find%2:38:10:: | definition=succeed in reaching; arrive at | examples=The arrow found its mark
16. sense_key=find%2:30:13:: | definition=accept and make use of one's personality, abilities, and situation | synonyms=find oneself | examples=My son went to Berkeley to find himself

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    come upon, as if by accident; meet with

    find%2:40:02:: · find.v.01

    • We find this idea in Plato
    • I happened upon the most wonderful bakery not very far from here

    Synonyms: happen, chance, bump, encounter

  2. 2

    discover or determine the existence, presence, or fact of

    find%2:39:02:: · detect.v.01

    • She detected high levels of lead in her drinking water
    • We found traces of lead in the paint

    Synonyms: detect, observe, discover, notice

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    come upon after searching; find the location of something that was missed or lost

    find%2:40:00:: · find.v.03

    • Did you find your glasses?
    • I cannot find my gloves!

    Synonyms: regain

    Selected
  4. 4

    establish after a calculation, investigation, experiment, survey, or study

    find%2:32:00:: · determine.v.01

    • find the product of two numbers
    • The physicist who found the elusive particle won the Nobel Prize

    Synonyms: determine, find out, ascertain

  5. 5

    come to believe on the basis of emotion, intuitions, or indefinite grounds

    find%2:31:10:: · find.v.05

    • I feel that he doesn't like me
    • I find him to be obnoxious

    Synonyms: feel

  6. 6

    perceive or be contemporaneous with

    find%2:39:01:: · witness.v.02

    • We found Republicans winning the offices
    • You'll see a lot of cheating in this school

    Synonyms: witness, see

  7. 7

    get something or somebody for a specific purpose

    find%2:40:01:: · line_up.v.02

    • I found this gadget that will serve as a bottle opener
    • I got hold of these tools to fix our plumbing

    Synonyms: line up, get hold, come up

  8. 8

    make a discovery, make a new finding

    find%2:36:00:: · discover.v.03

    • Roentgen discovered X-rays
    • Physicists believe they found a new elementary particle

    Synonyms: discover

  9. 9

    make a discovery

    find%2:31:09:: · discover.v.04

    • She found that he had lied to her
    • The story is false, so far as I can discover

    Synonyms: discover

  10. 10

    obtain through effort or management

    find%2:40:03:: · find.v.10

    • She found the time and energy to take care of her aging parents
    • We found the money to send our sons to college
  11. 11

    decide on and make a declaration about

    find%2:32:01:: · rule.v.04

    • find someone guilty

    Synonyms: rule

  12. 12

    receive a specified treatment (abstract)

    find%2:30:00:: · receive.v.02

    • These aspects of civilization do not find expression or receive an interpretation
    • His movie received a good review

    Synonyms: receive, get, obtain, incur

  13. 13

    perceive oneself to be in a certain condition or place

    find%2:39:05:: · find.v.13

    • I found myself in a difficult situation
    • When he woke up, he found himself in a hospital room
  14. 14

    get or find back; recover the use of

    find%2:40:15:: · recover.v.01

    • She regained control of herself
    • She found her voice and replied quickly

    Synonyms: recover, retrieve, regain

  15. 15

    succeed in reaching; arrive at

    find%2:38:10:: · find.v.15

    • The arrow found its mark
  16. 16

    accept and make use of one's personality, abilities, and situation

    find%2:30:13:: · find_oneself.v.01

    • My son went to Berkeley to find himself

    Synonyms: find oneself

realize Verb

Instance: semeval2015.d001.s009.t006 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge.

Here's a screenshot of kalgebra main window

kalgebra main window

kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab.

Below these tabs you will find an input field to type your functions or do your calculations.

If we want to understand how it works, the best thing we can do is to realize that our input is being converted into MathML although it is not necessary to know MathML.

I have based the syntax basically on common sense, it should not be hard for anyone.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: realize
Target surface form: realize
Context:
Although it was initially MathML oriented it can now be used by everyone with little mathematical knowledge. Here's a screenshot of kalgebra main window kalgebra main window kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab. Below these tabs you will find an input field to type your functions or do your calculations. If we want to understand how it works, the best thing we can do is to <t>realize</t> that our input is being converted into MathML although it is not necessary to know MathML. I have based the syntax basically on common sense, it should not be hard for anyone.

Candidate senses:
1. sense_key=realize%2:31:01:: | definition=be fully aware or cognizant of | synonyms=recognize, recognise, realise, agnize, agnise
2. sense_key=realize%2:31:00:: | definition=perceive (an idea or situation) mentally | synonyms=understand, realise, see | examples=Now I see!; I just can't see your point
3. sense_key=realize%2:36:00:: | definition=make real or concrete; give reality or substance to | synonyms=realise, actualize, actualise, substantiate | examples=our ideas must be substantiated into actions
4. sense_key=realize%2:40:01:: | definition=earn on some commercial or business transaction; earn as salary or wages | synonyms=gain, take in, clear, make, earn, realise | examples=How much do you make a month in your new job?; She earns a lot in her new job
5. sense_key=realize%2:40:00:: | definition=convert into cash; of goods and property | synonyms=realise
6. sense_key=realize%2:36:07:: | definition=expand or complete (a part in a piece of baroque music) by supplying the harmonies indicated in the figured bass | synonyms=realise

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    be fully aware or cognizant of

    realize%2:31:01:: · recognize.v.02

    Synonyms: recognize, recognise, realise, agnize, agnise

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    perceive (an idea or situation) mentally

    realize%2:31:00:: · understand.v.02

    • Now I see!
    • I just can't see your point

    Synonyms: understand, realise, see

    Gold Raganato Selected
  3. 3

    make real or concrete; give reality or substance to

    realize%2:36:00:: · realize.v.03

    • our ideas must be substantiated into actions

    Synonyms: realise, actualize, actualise, substantiate

  4. 4

    earn on some commercial or business transaction; earn as salary or wages

    realize%2:40:01:: · gain.v.08

    • How much do you make a month in your new job?
    • She earns a lot in her new job

    Synonyms: gain, take in, clear, make, earn, realise, pull in, bring in

  5. 5

    convert into cash; of goods and property

    realize%2:40:00:: · realize.v.05

    Synonyms: realise

  6. 6

    expand or complete (a part in a piece of baroque music) by supplying the harmonies indicated in the figured bass

    realize%2:36:07:: · realize.v.06

    Synonyms: realise