Verified run

gpt-5-mini

gpt-5-mini-high-reasoning-p003-lexen-v1-20260617

Rank
49
Accuracy lexEN v1 · WordNet fine
91.22%
Correct
4434 / 4861
Actual run cost
$3.36
Cost / M items
$690

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 91.22% 4434 / 4861 97.10% 4720 / 4861 94.63% 4600 / 4861
Maru 2022 (ALLamended) 88.42% 4298 / 4861 96.24% 4678 / 4861 92.80% 4511 / 4861
Raganato 2017 (original) 82.41% 4006 / 4861 93.38% 4539 / 4861 88.73% 4313 / 4861

Model

Display
gpt-5-mini
Requested
gpt-5-mini
Resolved
gpt-5-mini-2025-08-07
Vendor
OpenAI
API provider
OpenAI
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
high
Model URL
n/a
Endpoint
n/a
Resolved counts
gpt-5-mini-2025-08-07: 4861

Reproducibility

Created
2026-06-17T07:47:29.768045+00:00
Run schema
sensebench-run-v2
Commit
403163459ae447199cc2757a1b411bcf1fa15234
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p003
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
4,867,475
Tokens / item
1,001.3
Total cost
$3.36
Cost / M items
$690
Cost source
litellm_estimate
Elapsed
2.04m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
8,192
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $3.36. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 2,080,031 $0.520 $0.250
Input cached 0 $0.00 $0.0250
Output 1,418,036 $2.84 $2.00
Reasoning output 1,369,408 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 88.29% 701 794
Candidate Count 2 95.91% 820 855
Candidate Count 3-5 91.77% 1785 1945
Candidate Count 6-10 89.03% 1128 1267
POS ADJ 92.26% 608 659
POS ADV 88.72% 173 195
POS NOUN 92.34% 2675 2897
POS VERB 88.11% 978 1110
Source Dataset semeval2013 94.39% 1076 1140
Source Dataset semeval2015 90.80% 671 739
Source Dataset senseval2 89.87% 1464 1629
Source Dataset senseval3 90.39% 1223 1353

Worst-Bucket Examples

reach Verb

Instance: semeval2015.d000.s001.t009 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

This document is a summary of the European Public Assessment Report (EPAR).

It explains how the Committee for Medicinal Products for Human Use (CHMP) assessed the studies performed, to reach their recommendations on how to use the medicine.

If you need more information about your medical condition or your treatment, read the Package Leaflet (also part of the EPAR) or contact your doctor or pharmacist.

Show raw prompt

user

Which numbered sense of "reach" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: This document is a summary of the European Public Assessment Report (EPAR). It explains how the Committee for Medicinal Products for Human Use (CHMP) assessed the studies performed, to <t>reach</t> their recommendations on how to use the medicine. If you need more information about your medical condition or your treatment, read the Package Leaflet (also part of the EPAR) or contact your doctor or pharmacist.

Senses:
1. definition=reach a destination, either real or abstract | synonyms=make, attain, hit, arrive at, gain | examples=We hit Detroit by noon; The water reached the doorstep
2. definition=reach a point in time, or a certain state or level | synonyms=hit, attain | examples=The thermometer hit 100 degrees; This car can reach a speed of 140 miles per hour
3. definition=move forward or upward in order to touch; also in a metaphorical sense | synonyms=reach out | examples=Government reaches out to the people
4. definition=be in or establish communication with | synonyms=get through, get hold of, contact | examples=Our advertisements reach millions; He never contacted his children after he emigrated to Australia
5. definition=to gain with effort | synonyms=achieve, accomplish, attain | examples=she achieved her goal despite setbacks
6. definition=to extend as far as | synonyms=extend to, touch | examples=The sunlight reached the wall; Can he reach?
7. definition=reach a goal, e.g., | synonyms=make, get to, progress to | examples=make the first team; We made it!
8. definition=place into the hands or custody of | synonyms=pass, hand, pass on, turn over, give | examples=hand me the spoon, please; Turn the files over to me, please
9. definition=to exert much effort or energy | synonyms=strive, strain | examples=straining our ears to hear

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    reach a destination, either real or abstract

    reach%2:38:01:: · reach.v.01

    • We hit Detroit by noon
    • The water reached the doorstep

    Synonyms: make, attain, hit, arrive at, gain

    Selected
  2. 2

    reach a point in time, or a certain state or level

    reach%2:38:00:: · reach.v.02

    • The thermometer hit 100 degrees
    • This car can reach a speed of 140 miles per hour

    Synonyms: hit, attain

  3. 3

    move forward or upward in order to touch; also in a metaphorical sense

    reach%2:35:00:: · reach.v.03

    • Government reaches out to the people

    Synonyms: reach out

  4. 4

    be in or establish communication with

    reach%2:32:00:: · reach.v.04

    • Our advertisements reach millions
    • He never contacted his children after he emigrated to Australia

    Synonyms: get through, get hold of, contact

  5. 5

    to gain with effort

    reach%2:41:00:: · achieve.v.01

    • she achieved her goal despite setbacks

    Synonyms: achieve, accomplish, attain

    Gold lexEN Gold Maru 2022 Gold Raganato
  6. 6

    to extend as far as

    reach%2:42:00:: · reach.v.06

    • The sunlight reached the wall
    • Can he reach?

    Synonyms: extend to, touch

  7. 7

    reach a goal, e.g.,

    reach%2:38:06:: · reach.v.07

    • make the first team
    • We made it!

    Synonyms: make, get to, progress to

    Gold lexEN Gold Maru 2022 Gold Raganato
  8. 8

    place into the hands or custody of

    reach%2:40:00:: · pass.v.05

    • hand me the spoon, please
    • Turn the files over to me, please

    Synonyms: pass, hand, pass on, turn over, give

  9. 9

    to exert much effort or energy

    reach%2:33:00:: · strive.v.02

    • straining our ears to hear

    Synonyms: strive, strain

drip Verb

Instance: semeval2015.d000.s005.t004 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

This document is a summary of the European Public Assessment Report (EPAR).

It explains how the Committee for Medicinal Products for Human Use (CHMP) assessed the studies performed, to reach their recommendations on how to use the medicine.

If you need more information about your medical condition or your treatment, read the Package Leaflet (also part of the EPAR) or contact your doctor or pharmacist.

If you want more information on the basis of the CHMP recommendations, read the Scientific Discussion (also part of the EPAR).

What is Alimta?

Alimta is a powder that is made up into a solution for infusion (drip into a vein).

It contains the active substance pemetrexed.

Show raw prompt

user

Which numbered sense of "drip" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: This document is a summary of the European Public Assessment Report (EPAR). It explains how the Committee for Medicinal Products for Human Use (CHMP) assessed the studies performed, to reach their recommendations on how to use the medicine. If you need more information about your medical condition or your treatment, read the Package Leaflet (also part of the EPAR) or contact your doctor or pharmacist. If you want more information on the basis of the CHMP recommendations, read the Scientific Discussion (also part of the EPAR). What is Alimta? Alimta is a powder that is made up into a solution for infusion (<t>drip</t> into a vein). It contains the active substance pemetrexed.

Senses:
1. definition=fall in drops | examples=Water is dripping from the faucet
2. definition=let or cause to fall in drops | synonyms=dribble, drop | examples=dribble oil into the mixture

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    fall in drops

    drip%2:38:00:: · drip.v.01

    • Water is dripping from the faucet
    Selected
  2. 2

    let or cause to fall in drops

    drip%2:35:10:: · dribble.v.02

    • dribble oil into the mixture

    Synonyms: dribble, drop

    Gold lexEN Gold Maru 2022 Gold Raganato

prevent Verb

Instance: semeval2015.d000.s017.t002 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

How is Alimta used?

Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy.

The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight).

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta.

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Show raw prompt

user

Which numbered sense of "prevent" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: How is Alimta used? Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy. The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight). It is given once every three weeks as an intravenous infusion lasting 10 minutes. To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta. When Alimta is given with cisplatin, an anti-emetic medicine (to <t>prevent</t> vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Senses:
1. definition=keep from happening or arising; make impossible | synonyms=forestall, foreclose, preclude, forbid | examples=My sense of tact forbids an honest answer; Your role in the projects precludes your involvement in the competitive project
2. definition=stop (someone or something) from doing something or being in a certain state | synonyms=keep | examples=We must prevent the cancer from spreading; His snoring kept me from falling asleep

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    keep from happening or arising; make impossible

    prevent%2:41:01:: · prevent.v.01

    • My sense of tact forbids an honest answer
    • Your role in the projects precludes your involvement in the competitive project

    Synonyms: forestall, foreclose, preclude, forbid

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    stop (someone or something) from doing something or being in a certain state

    prevent%2:41:00:: · prevent.v.02

    • We must prevent the cancer from spreading
    • His snoring kept me from falling asleep

    Synonyms: keep

    Gold Raganato Selected

prevent Verb

Instance: semeval2015.d000.s017.t005 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

How is Alimta used?

Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy.

The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight).

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta.

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Show raw prompt

user

Which numbered sense of "prevent" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: How is Alimta used? Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy. The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight). It is given once every three weeks as an intravenous infusion lasting 10 minutes. To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta. When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to <t>prevent</t> dehydration) should also be given before or after the cisplatin dose. Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Senses:
1. definition=keep from happening or arising; make impossible | synonyms=forestall, foreclose, preclude, forbid | examples=My sense of tact forbids an honest answer; Your role in the projects precludes your involvement in the competitive project
2. definition=stop (someone or something) from doing something or being in a certain state | synonyms=keep | examples=We must prevent the cancer from spreading; His snoring kept me from falling asleep

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    keep from happening or arising; make impossible

    prevent%2:41:01:: · prevent.v.01

    • My sense of tact forbids an honest answer
    • Your role in the projects precludes your involvement in the competitive project

    Synonyms: forestall, foreclose, preclude, forbid

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    stop (someone or something) from doing something or being in a certain state

    prevent%2:41:00:: · prevent.v.02

    • We must prevent the cancer from spreading
    • His snoring kept me from falling asleep

    Synonyms: keep

    Gold Raganato Selected

delay Verb

Instance: semeval2015.d000.s018.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy.

The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight).

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta.

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

Show raw prompt

user

Which numbered sense of "delay" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy. The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight). It is given once every three weeks as an intravenous infusion lasting 10 minutes. To reduce side effects, patients should take a corticosteroid and folic acid (a type of vitamin), and receive injections of vitamin B12 during treatment with Alimta. When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be <t>delayed</t> or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems.

Senses:
1. definition=cause to be slowed down or delayed | synonyms=detain, hold up | examples=Traffic was delayed by the bad weather; she delayed the work that she didn't want to perform
2. definition=act later than planned, scheduled, or required | examples=Don't delay your application to graduate school or else it won't be considered
3. definition=stop or halt | synonyms=stay, detain | examples=Please stay the bloodshed!
4. definition=slow the growth or development of | synonyms=check, retard | examples=The brain damage will retard the child's language development

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    cause to be slowed down or delayed

    delay%2:30:00:: · delay.v.01

    • Traffic was delayed by the bad weather
    • she delayed the work that she didn't want to perform

    Synonyms: detain, hold up

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    act later than planned, scheduled, or required

    delay%2:42:00:: · delay.v.02

    • Don't delay your application to graduate school or else it won't be considered
    Gold Raganato Selected
  3. 3

    stop or halt

    delay%2:30:01:: · stay.v.06

    • Please stay the bloodshed!

    Synonyms: stay, detain

  4. 4

    slow the growth or development of

    delay%2:30:05:: · check.v.07

    • The brain damage will retard the child's language development

    Synonyms: check, retard

divide Verb

Instance: semeval2015.d000.s022.t007 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Show raw prompt

user

Which numbered sense of "divide" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose. Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are <t>dividing</t>, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Senses:
1. definition=separate into parts or portions | synonyms=split, split up, separate, dissever, carve up | examples=divide the cake into three equal parts; The British carved up the Ottoman Empire after World War I
2. definition=perform a division | synonyms=fraction | examples=Can you divide 49 by seven?
3. definition=act as a barrier between; stand between | synonyms=separate | examples=The mountain range divides the two countries
4. definition=come apart | synonyms=separate, part | examples=The two pieces that we had glued separated
5. definition=make a division or separation | synonyms=separate
6. definition=force, take, or pull apart | synonyms=separate, disunite, part | examples=He separated the fighting children; Moses parted the Red Sea

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    separate into parts or portions

    divide%2:41:00:: · divide.v.01

    • divide the cake into three equal parts
    • The British carved up the Ottoman Empire after World War I

    Synonyms: split, split up, separate, dissever, carve up

  2. 2

    perform a division

    divide%2:31:00:: · divide.v.02

    • Can you divide 49 by seven?

    Synonyms: fraction

    Selected
  3. 3

    act as a barrier between; stand between

    divide%2:42:00:: · separate.v.01

    • The mountain range divides the two countries

    Synonyms: separate

  4. 4

    come apart

    divide%2:35:00:: · separate.v.12

    • The two pieces that we had glued separated

    Synonyms: separate, part

    Gold lexEN Gold Maru 2022 Gold Raganato
  5. 5

    make a division or separation

    divide%2:38:00:: · separate.v.07

    Synonyms: separate

    Gold Raganato
  6. 6

    force, take, or pull apart

    divide%2:35:01:: · separate.v.02

    • He separated the fighting children
    • Moses parted the Red Sea

    Synonyms: separate, disunite, part

convert Verb

Instance: semeval2015.d000.s023.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

Show raw prompt

user

Which numbered sense of "convert" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is <t>converted</t> into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied?

Senses:
1. definition=change from one system to another or to a new plan or policy | synonyms=change over | examples=We converted from 220 to 110 Volt
2. definition=change the nature, purpose, or function of something | examples=convert lead into gold; convert hotels into jails
3. definition=change religious beliefs, or adopt a religious belief | examples=She converted to Buddhism
4. definition=exchange or replace with another, usually of the same kind or category | synonyms=change, exchange, commute | examples=Could you convert my dollars into pounds?; He changed his name
5. definition=cause to adopt a new or different faith | examples=The missionaries converted the Indian population
6. definition=score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone | examples=Smith converted and his team won
7. definition=complete successfully | examples=score a penalty shot or free throw
8. definition=score (a spare)
9. definition=make (someone) agree, understand, or realize the truth or validity of something | synonyms=win over, convince | examples=He had finally convinced several customers of the advantages of his product
10. definition=exchange a penalty for a less severe one | synonyms=commute, exchange
11. definition=change in nature, purpose, or function; undergo a chemical change | examples=The substance converts to an acid

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    change from one system to another or to a new plan or policy

    convert%2:30:00:: · convert.v.01

    • We converted from 220 to 110 Volt

    Synonyms: change over

  2. 2

    change the nature, purpose, or function of something

    convert%2:30:03:: · convert.v.02

    • convert lead into gold
    • convert hotels into jails
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    change religious beliefs, or adopt a religious belief

    convert%2:30:01:: · convert.v.03

    • She converted to Buddhism
  4. 4

    exchange or replace with another, usually of the same kind or category

    convert%2:30:02:: · change.v.06

    • Could you convert my dollars into pounds?
    • He changed his name

    Synonyms: change, exchange, commute

  5. 5

    cause to adopt a new or different faith

    convert%2:30:07:: · convert.v.05

    • The missionaries converted the Indian population
  6. 6

    score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone

    convert%2:33:02:: · convert.v.06

    • Smith converted and his team won
  7. 7

    complete successfully

    convert%2:33:01:: · convert.v.07

    • score a penalty shot or free throw
  8. 8

    score (a spare)

    convert%2:33:00:: · convert.v.08

  9. 9

    make (someone) agree, understand, or realize the truth or validity of something

    convert%2:32:00:: · convert.v.09

    • He had finally convinced several customers of the advantages of his product

    Synonyms: win over, convince

  10. 10

    exchange a penalty for a less severe one

    convert%2:30:09:: · commute.v.04

    Synonyms: commute, exchange

  11. 11

    change in nature, purpose, or function; undergo a chemical change

    convert%2:30:04:: · convert.v.11

    • The substance converts to an acid
    Gold Raganato Selected

block Verb

Instance: semeval2015.d000.s023.t004 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

Show raw prompt

user

Which numbered sense of "block" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is converted into an active form that <t>blocks</t> the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied?

Senses:
1. definition=render unsuitable for passage | synonyms=barricade, blockade, stop, block off, block up, bar | examples=block the way; barricade the streets
2. definition=hinder or prevent the progress or accomplishment of | synonyms=obstruct, blockade, hinder, stymie, stymy, embarrass | examples=His brother blocked him at every turn
3. definition=stop from happening or developing | synonyms=stop, halt, kibosh | examples=Block his election; Halt the process
4. definition=interfere with or prevent the reception of signals | synonyms=jam | examples=Jam the Voice of America; block the signals emitted by this station
5. definition=run on a block system | examples=block trains
6. definition=interrupt the normal function of by means of anesthesia | examples=block a nerve; block a muscle
7. definition=shut out from view or get in the way so as to hide from sight | synonyms=obstruct | examples=The thick curtain blocked the action on the stage; The trees obstruct my view of the mountains
8. definition=stamp or emboss a title or design on a book with a block | examples=block the book cover
9. definition=obstruct | synonyms=stuff, lug, choke up | examples=My nose is all stuffed; Her arteries are blocked
10. definition=block passage through | synonyms=obstruct, obturate, impede, occlude, jam, close up | examples=obstruct the path
11. definition=support, secure, or raise with a block | examples=block a plate for printing; block the wheels of a car
12. definition=impede the movement of (an opponent or a ball) | synonyms=parry, deflect | examples=block an attack
13. definition=be unable to remember | synonyms=forget, blank out, draw a blank | examples=I'm drawing a blank; You are blocking the name of your first wife!
14. definition=shape by using a block | examples=Block a hat; block a garment
15. definition=shape into a block or blocks | examples=block the graphs so one can see the results clearly
16. definition=prohibit the conversion or use of (assets) | synonyms=freeze, immobilize, immobilise | examples=Blocked funds; Freeze the assets of this hostile government

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    render unsuitable for passage

    block%2:35:00:: · barricade.v.01

    • block the way
    • barricade the streets

    Synonyms: barricade, blockade, stop, block off, block up, bar

  2. 2

    hinder or prevent the progress or accomplishment of

    block%2:41:00:: · obstruct.v.01

    • His brother blocked him at every turn

    Synonyms: obstruct, blockade, hinder, stymie, stymy, embarrass

    Selected
  3. 3

    stop from happening or developing

    block%2:41:01:: · stop.v.03

    • Block his election
    • Halt the process

    Synonyms: stop, halt, kibosh

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    interfere with or prevent the reception of signals

    block%2:32:00:: · jam.v.04

    • Jam the Voice of America
    • block the signals emitted by this station

    Synonyms: jam

  5. 5

    run on a block system

    block%2:41:03:: · block.v.05

    • block trains
  6. 6

    interrupt the normal function of by means of anesthesia

    block%2:39:05:: · block.v.06

    • block a nerve
    • block a muscle
  7. 7

    shut out from view or get in the way so as to hide from sight

    block%2:39:00:: · obstruct.v.03

    • The thick curtain blocked the action on the stage
    • The trees obstruct my view of the mountains

    Synonyms: obstruct

  8. 8

    stamp or emboss a title or design on a book with a block

    block%2:35:03:: · block.v.08

    • block the book cover
  9. 9

    obstruct

    block%2:35:02:: · stuff.v.03

    • My nose is all stuffed
    • Her arteries are blocked

    Synonyms: stuff, lug, choke up

  10. 10

    block passage through

    block%2:35:12:: · obstruct.v.02

    • obstruct the path

    Synonyms: obstruct, obturate, impede, occlude, jam, close up

  11. 11

    support, secure, or raise with a block

    block%2:35:06:: · block.v.11

    • block a plate for printing
    • block the wheels of a car
  12. 12

    impede the movement of (an opponent or a ball)

    block%2:33:00:: · parry.v.01

    • block an attack

    Synonyms: parry, deflect

  13. 13

    be unable to remember

    block%2:31:00:: · forget.v.02

    • I'm drawing a blank
    • You are blocking the name of your first wife!

    Synonyms: forget, blank out, draw a blank

  14. 14

    shape by using a block

    block%2:30:01:: · block.v.14

    • Block a hat
    • block a garment
  15. 15

    shape into a block or blocks

    block%2:30:00:: · block.v.15

    • block the graphs so one can see the results clearly
  16. 16

    prohibit the conversion or use of (assets)

    block%2:30:02:: · freeze.v.08

    • Blocked funds
    • Freeze the assets of this hostile government

    Synonyms: freeze, immobilize, immobilise

produce Verb

Instance: semeval2015.d000.s023.t008 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Alimta is not recommended for use in patients with moderate or severe kidney problems.

For more information, see the Summary of Product Characteristics (also part of the EPAR).

How does Alimta work?

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

Show raw prompt

user

Which numbered sense of "produce" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects. Alimta is not recommended for use in patients with moderate or severe kidney problems. For more information, see the Summary of Product Characteristics (also part of the EPAR). How does Alimta work? The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in <t>producing</t> nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied?

Senses:
1. definition=bring forth or yield | synonyms=bring forth | examples=The tree would not produce fruit
2. definition=create or manufacture a man-made product | synonyms=make, create | examples=We produce more cars than we can sell; The company has been making toys for two centuries
3. definition=cause to happen, occur or exist | synonyms=bring about, give rise | examples=This procedure produces a curious effect; The new law gave rise to many complaints
4. definition=bring out for display | synonyms=bring forth | examples=The proud father produced many pictures of his baby; The accused brought forth a letter in court that he claims exonerates him
5. definition=cultivate by growing, often involving improvements by means of agricultural techniques | synonyms=grow, raise, farm | examples=The Bordeaux region produces great red wines; They produce good ham in Parma
6. definition=bring onto the market or release | synonyms=bring on, bring out | examples=produce a movie; bring out a book
7. definition=come to have or undergo a change of (physical features and attributes) | synonyms=grow, develop, get, acquire | examples=He grew a beard; The patient developed abdominal pains

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    bring forth or yield

    produce%2:36:02:: · produce.v.01

    • The tree would not produce fruit

    Synonyms: bring forth

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    create or manufacture a man-made product

    produce%2:36:00:: · produce.v.02

    • We produce more cars than we can sell
    • The company has been making toys for two centuries

    Synonyms: make, create

    Selected
  3. 3

    cause to happen, occur or exist

    produce%2:36:03:: · produce.v.03

    • This procedure produces a curious effect
    • The new law gave rise to many complaints

    Synonyms: bring about, give rise

    Gold lexEN Gold Maru 2022
  4. 4

    bring out for display

    produce%2:39:01:: · produce.v.04

    • The proud father produced many pictures of his baby
    • The accused brought forth a letter in court that he claims exonerates him

    Synonyms: bring forth

  5. 5

    cultivate by growing, often involving improvements by means of agricultural techniques

    produce%2:36:05:: · grow.v.07

    • The Bordeaux region produces great red wines
    • They produce good ham in Parma

    Synonyms: grow, raise, farm

  6. 6

    bring onto the market or release

    produce%2:39:00:: · produce.v.06

    • produce a movie
    • bring out a book

    Synonyms: bring on, bring out

  7. 7

    come to have or undergo a change of (physical features and attributes)

    produce%2:29:00:: · grow.v.08

    • He grew a beard
    • The patient developed abdominal pains

    Synonyms: grow, develop, get, acquire

involve Verb

Instance: semeval2015.d000.s027.t008 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites.

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before.

The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone.

For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

Show raw prompt

user

Which numbered sense of "involve" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: The active substance in Alimta, pemetrexed, is a cytotoxic medicine (a medicine that kills cells that are dividing, such as cancer cells), which belongs to the group antimetabolites. In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied? For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before. The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone. For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study <t>involving</t> 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past. Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

Senses:
1. definition=connect closely and often incriminatingly | synonyms=affect, regard | examples=This new ruling affects your business
2. definition=engage as a participant | examples=Don't involve me in your family affairs!
3. definition=have as a necessary feature | synonyms=imply | examples=This decision involves many changes
4. definition=require as useful, just, or proper | synonyms=necessitate, ask, postulate, need, require, take | examples=It takes nerve to do what she did; success usually requires hard work
5. definition=contain as a part | examples=Dinner at Joe's always involves at least six courses
6. definition=occupy or engage the interest of | examples=His story completely involved me during the entire afternoon
7. definition=make complex or intricate or complicated | examples=The situation was rather involved

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    connect closely and often incriminatingly

    involve%2:42:01:: · involve.v.01

    • This new ruling affects your business

    Synonyms: affect, regard

  2. 2

    engage as a participant

    involve%2:42:04:: · involve.v.02

    • Don't involve me in your family affairs!
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    have as a necessary feature

    involve%2:42:00:: · imply.v.05

    • This decision involves many changes

    Synonyms: imply

  4. 4

    require as useful, just, or proper

    involve%2:42:07:: · necessitate.v.01

    • It takes nerve to do what she did
    • success usually requires hard work

    Synonyms: necessitate, ask, postulate, need, require, take, call for, demand

  5. 5

    contain as a part

    involve%2:42:02:: · involve.v.05

    • Dinner at Joe's always involves at least six courses
    Selected
  6. 6

    occupy or engage the interest of

    involve%2:31:00:: · involve.v.06

    • His story completely involved me during the entire afternoon
  7. 7

    make complex or intricate or complicated

    involve%2:30:00:: · involve.v.07

    • The situation was rather involved

involve Verb

Instance: semeval2015.d000.s028.t006 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

How has Alimta been studied?

For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before.

The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone.

For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

In all three studies, the main measure of effectiveness was how long the patients survived.

Show raw prompt

user

Which numbered sense of "involve" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells). How has Alimta been studied? For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before. The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone. For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past. Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study <t>involving</t> 1,725 patients who had not received chemotherapy for lung cancer in the past. In all three studies, the main measure of effectiveness was how long the patients survived.

Senses:
1. definition=connect closely and often incriminatingly | synonyms=affect, regard | examples=This new ruling affects your business
2. definition=engage as a participant | examples=Don't involve me in your family affairs!
3. definition=have as a necessary feature | synonyms=imply | examples=This decision involves many changes
4. definition=require as useful, just, or proper | synonyms=necessitate, ask, postulate, need, require, take | examples=It takes nerve to do what she did; success usually requires hard work
5. definition=contain as a part | examples=Dinner at Joe's always involves at least six courses
6. definition=occupy or engage the interest of | examples=His story completely involved me during the entire afternoon
7. definition=make complex or intricate or complicated | examples=The situation was rather involved

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    connect closely and often incriminatingly

    involve%2:42:01:: · involve.v.01

    • This new ruling affects your business

    Synonyms: affect, regard

  2. 2

    engage as a participant

    involve%2:42:04:: · involve.v.02

    • Don't involve me in your family affairs!
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    have as a necessary feature

    involve%2:42:00:: · imply.v.05

    • This decision involves many changes

    Synonyms: imply

  4. 4

    require as useful, just, or proper

    involve%2:42:07:: · necessitate.v.01

    • It takes nerve to do what she did
    • success usually requires hard work

    Synonyms: necessitate, ask, postulate, need, require, take, call for, demand

  5. 5

    contain as a part

    involve%2:42:02:: · involve.v.05

    • Dinner at Joe's always involves at least six courses
    Selected
  6. 6

    occupy or engage the interest of

    involve%2:31:00:: · involve.v.06

    • His story completely involved me during the entire afternoon
  7. 7

    make complex or intricate or complicated

    involve%2:30:00:: · involve.v.07

    • The situation was rather involved

survive Verb

Instance: semeval2015.d000.s029.t006 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

How has Alimta been studied?

For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before.

The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone.

For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

In all three studies, the main measure of effectiveness was how long the patients survived.

What benefit has Alimta shown during the studies?

Show raw prompt

user

Which numbered sense of "survive" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: How has Alimta been studied? For the treatment of malignant pleural mesothelioma, Alimta has been studied in one main study in 456 patients who had not received chemotherapy for their disease before. The effects of Alimta in combination with cisplatin were compared with those of cisplatin alone. For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past. Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past. In all three studies, the main measure of effectiveness was how long the patients <t>survived</t>. What benefit has Alimta shown during the studies?

Senses:
1. definition=continue to live through hardship or adversity | synonyms=last, live, live on, go, endure, hold up | examples=We went without water and food for 3 days; These superstitions survive in the backwaters of America
2. definition=continue in existence after (an adversity, etc.) | synonyms=pull through, pull round, come through, make it | examples=He survived the cancer against all odds
3. definition=support oneself | synonyms=exist, live, subsist | examples=he could barely exist on such a low wage; Can you live on $2000 a month in New York City?
4. definition=live longer than | synonyms=outlive, outlast | examples=She outlived her husband by many years

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    continue to live through hardship or adversity

    survive%2:42:01:: · survive.v.01

    • We went without water and food for 3 days
    • These superstitions survive in the backwaters of America

    Synonyms: last, live, live on, go, endure, hold up, hold out

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    continue in existence after (an adversity, etc.)

    survive%2:42:02:: · survive.v.02

    • He survived the cancer against all odds

    Synonyms: pull through, pull round, come through, make it

    Gold Raganato Selected
  3. 3

    support oneself

    survive%2:42:00:: · exist.v.02

    • he could barely exist on such a low wage
    • Can you live on $2000 a month in New York City?

    Synonyms: exist, live, subsist

  4. 4

    live longer than

    survive%2:42:03:: · outlive.v.01

    • She outlived her husband by many years

    Synonyms: outlive, outlast