Verified run

gpt-6-luna

gpt-6-luna-none-reasoning-p002-lexen-v1-20261009

Rank
163
Accuracy lexEN v1 · WordNet fine
88.44%
Correct
4299 / 4861
Actual run cost
$0.122
Cost / M items
$25.00

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 88.44% 4299 / 4861 95.49% 4642 / 4861 92.22% 4483 / 4861
Maru 2022 (ALLamended) 86.07% 4184 / 4861 94.63% 4600 / 4861 90.74% 4411 / 4861
Raganato 2017 (original) 80.35% 3906 / 4861 92.41% 4492 / 4861 87.02% 4230 / 4861

Model

Display
gpt-6-luna
Requested
gpt-6-luna
Resolved
gpt-6-luna
Vendor
OpenAI
API provider
OpenAI
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
none
Model URL
n/a
Endpoint
n/a
Resolved counts
gpt-6-luna: 4861

Reproducibility

Created
2026-10-09T13:24:21.916168+00:00
Run schema
sensebench-run-v2
Commit
9040664a78ce4afacbe5400eaf6538ee664f3dea
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p002
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
1,137,331
Tokens / item
234.0
Total cost
$0.122
Cost / M items
$25.00
Cost source
litellm_estimate
Elapsed
1.37m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
32,768
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.122. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 1,117,887 $0.112 $0.100
Input cached 0 $0.00 $0.0100
Output 19,444 $0.00972 $0.500
Reasoning output 0 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 84.89% 674 794
Candidate Count 2 94.15% 805 855
Candidate Count 3-5 87.66% 1705 1945
Candidate Count 6-10 88.00% 1115 1267
POS ADJ 89.07% 587 659
POS ADV 87.69% 171 195
POS NOUN 89.71% 2599 2897
POS VERB 84.86% 942 1110
Source Dataset semeval2013 90.18% 1028 1140
Source Dataset semeval2015 88.09% 651 739
Source Dataset senseval2 89.50% 1458 1629
Source Dataset senseval3 85.88% 1162 1353

Worst-Bucket Examples

drip Verb

Instance: semeval2015.d000.s005.t004 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Alimta is a powder that is made up into a solution for infusion (drip into a vein).

Show raw prompt

user

Which numbered sense of "drip" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Alimta is a powder that is made up into a solution for infusion (<t>drip</t> into a vein).

Senses:
1. definition=fall in drops | examples=Water is dripping from the faucet
2. definition=let or cause to fall in drops | examples=dribble oil into the mixture

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    fall in drops

    drip%2:38:00:: · drip.v.01

    • Water is dripping from the faucet
    Selected
  2. 2

    let or cause to fall in drops

    drip%2:35:10:: · dribble.v.02

    • dribble oil into the mixture

    Synonyms: dribble, drop

    Gold lexEN Gold Maru 2022 Gold Raganato

contain Verb

Instance: semeval2015.d000.s006.t000 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

It contains the active substance pemetrexed.

Show raw prompt

user

Which numbered sense of "contain" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: It <t>contains</t> the active substance pemetrexed.

Senses:
1. definition=include or contain; have as a component | examples=A totally new idea is comprised in this paper
2. definition=contain or hold; have within | examples=The jar carries wine
3. definition=lessen the intensity of; temper; hold in restraint; hold or keep within limits | examples=moderate your alcohol intake
4. definition=be divisible by | examples=24 contains 6
5. definition=be capable of holding or containing | examples=This box won't take all the items
6. definition=hold back, as of a danger or an enemy; check the expansion or influence of | examples=Arrest the downward trend

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    include or contain; have as a component

    contain%2:42:00:: · incorporate.v.02

    • A totally new idea is comprised in this paper
    • The record contains many old songs from the 1930's

    Synonyms: incorporate, comprise

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    contain or hold; have within

    contain%2:42:13:: · hold.v.11

    • The jar carries wine
    • The canteen holds fresh water

    Synonyms: hold, bear, carry

    Selected
  3. 3

    lessen the intensity of; temper; hold in restraint; hold or keep within limits

    contain%2:41:00:: · control.v.02

    • moderate your alcohol intake
    • hold your tongue

    Synonyms: control, hold in, hold, check, curb, moderate

  4. 4

    be divisible by

    contain%2:42:06:: · contain.v.04

    • 24 contains 6
  5. 5

    be capable of holding or containing

    contain%2:42:14:: · contain.v.05

    • This box won't take all the items
    • The flask holds one gallon

    Synonyms: take, hold

  6. 6

    hold back, as of a danger or an enemy; check the expansion or influence of

    contain%2:33:00:: · check.v.18

    • Arrest the downward trend
    • Check the growth of communism in South East Asia

    Synonyms: check, turn back, arrest, stop, hold back

affect Verb

Instance: semeval2015.d000.s009.t027 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread easily, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not affecting the squamous cells.

Show raw prompt

user

Which numbered sense of "affect" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread easily, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not <t>affecting</t> the squamous cells.

Senses:
1. definition=have an effect upon | examples=Will the new rules affect me?
2. definition=act physically on; have an effect upon | examples=the medicine affects my heart rate
3. definition=connect closely and often incriminatingly | examples=This new ruling affects your business
4. definition=make believe with the intent to deceive | examples=He feigned that he was ill
5. definition=have an emotional or cognitive impact upon | examples=This child impressed me as unusually mature

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    have an effect upon

    affect%2:30:00:: · affect.v.01

    • Will the new rules affect me?

    Synonyms: impact, bear upon, bear on, touch on, touch

    Selected
  2. 2

    act physically on; have an effect upon

    affect%2:29:00:: · affect.v.02

    • the medicine affects my heart rate
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    connect closely and often incriminatingly

    affect%2:42:00:: · involve.v.01

    • This new ruling affects your business

    Synonyms: involve, regard

  4. 4

    make believe with the intent to deceive

    affect%2:32:00:: · feign.v.01

    • He feigned that he was ill
    • He shammed a headache

    Synonyms: feign, sham, pretend, dissemble

  5. 5

    have an emotional or cognitive impact upon

    affect%2:37:00:: · affect.v.05

    • This child impressed me as unusually mature
    • This behavior struck me as odd

    Synonyms: impress, move, strike

prevent Verb

Instance: semeval2015.d000.s017.t005 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to prevent dehydration) should also be given before or after the cisplatin dose.

Show raw prompt

user

Which numbered sense of "prevent" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: When Alimta is given with cisplatin, an anti-emetic medicine (to prevent vomiting) and fluids (to <t>prevent</t> dehydration) should also be given before or after the cisplatin dose.

Senses:
1. definition=keep from happening or arising; make impossible | examples=My sense of tact forbids an honest answer
2. definition=stop (someone or something) from doing something or being in a certain state | examples=We must prevent the cancer from spreading

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    keep from happening or arising; make impossible

    prevent%2:41:01:: · prevent.v.01

    • My sense of tact forbids an honest answer
    • Your role in the projects precludes your involvement in the competitive project

    Synonyms: forestall, foreclose, preclude, forbid

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    stop (someone or something) from doing something or being in a certain state

    prevent%2:41:00:: · prevent.v.02

    • We must prevent the cancer from spreading
    • His snoring kept me from falling asleep

    Synonyms: keep

    Gold Raganato Selected

have Verb

Instance: semeval2015.d000.s018.t008 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Show raw prompt

user

Which numbered sense of "have" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who <t>have</t> certain other side effects.

Senses:
1. definition=have or possess, either in a concrete or an abstract sense | examples=She has $1,000 in the bank
2. definition=have as a feature | examples=This restaurant features the most famous chefs in France
3. definition=go through (mental or physical states or experiences) | examples=get an idea
4. definition=have ownership or possession of | examples=He owns three houses in Florida
5. definition=cause to move; cause to be in a certain position or condition | examples=He got his squad on the ball
6. definition=serve oneself to, or consume regularly | examples=Have another bowl of chicken soup!
7. definition=have a personal or business relationship with someone | examples=have a postdoc
8. definition=organize or be responsible for | examples=hold a reception
9. definition=have left | examples=I have two years left
10. definition=be confronted with | examples=What do we have here?
11. definition=undergo | examples=The stocks had a fast run-up
12. definition=suffer from; be ill with | examples=She has arthritis
13. definition=cause to do; cause to act in a specified manner | examples=The ads induced me to buy a VCR
14. definition=receive willingly something given or offered | examples=The only girl who would have him was the miller's daughter
15. definition=get something; come into possession of | examples=receive payment
16. definition=undergo (as of injuries and illnesses) | examples=She suffered a fracture in the accident
17. definition=achieve a point or goal | examples=Nicklaus had a 70
18. definition=cause to be born | examples=My wife had twins yesterday!
19. definition=have sex with; archaic use | examples=He had taken this woman when she was most vulnerable

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    have or possess, either in a concrete or an abstract sense

    have%2:40:00:: · have.v.01

    • She has $1,000 in the bank
    • He has got two beautiful daughters

    Synonyms: have got, hold

  2. 2

    have as a feature

    have%2:42:00:: · have.v.02

    • This restaurant features the most famous chefs in France

    Synonyms: feature

  3. 3

    go through (mental or physical states or experiences)

    have%2:39:06:: · experience.v.03

    • get an idea
    • experience vertigo

    Synonyms: experience, receive, get

    Gold lexEN Gold Maru 2022
  4. 4

    have ownership or possession of

    have%2:40:04:: · own.v.01

    • He owns three houses in Florida
    • How many cars does she have?

    Synonyms: own, possess

  5. 5

    cause to move; cause to be in a certain position or condition

    have%2:30:00:: · get.v.03

    • He got his squad on the ball
    • This let me in for a big surprise

    Synonyms: get, let

  6. 6

    serve oneself to, or consume regularly

    have%2:34:00:: · consume.v.02

    • Have another bowl of chicken soup!
    • I don't take sugar in my coffee

    Synonyms: consume, ingest, take in, take

  7. 7

    have a personal or business relationship with someone

    have%2:41:00:: · have.v.07

    • have a postdoc
    • have an assistant
  8. 8

    organize or be responsible for

    have%2:36:00:: · hold.v.03

    • hold a reception
    • have, throw, or make a party

    Synonyms: hold, throw, make, give

  9. 9

    have left

    have%2:40:01:: · have.v.09

    • I have two years left
    • I don't have any money left
  10. 10

    be confronted with

    have%2:42:12:: · have.v.10

    • What do we have here?
    • Now we have a fine mess
  11. 11

    undergo

    have%2:30:01:: · have.v.11

    • The stocks had a fast run-up

    Synonyms: experience

    Gold lexEN Gold Maru 2022
  12. 12

    suffer from; be ill with

    have%2:29:02:: · have.v.12

    • She has arthritis
    Gold Raganato Selected
  13. 13

    cause to do; cause to act in a specified manner

    have%2:32:00:: · induce.v.02

    • The ads induced me to buy a VCR
    • My children finally got me to buy a computer

    Synonyms: induce, stimulate, cause, get, make

  14. 14

    receive willingly something given or offered

    have%2:40:05:: · accept.v.02

    • The only girl who would have him was the miller's daughter
    • I won't have this dog in my house!

    Synonyms: accept, take

  15. 15

    get something; come into possession of

    have%2:40:03:: · receive.v.01

    • receive payment
    • receive a gift

    Synonyms: receive

  16. 16

    undergo (as of injuries and illnesses)

    have%2:29:05:: · suffer.v.02

    • She suffered a fracture in the accident
    • He had an insulin shock after eating three candy bars

    Synonyms: suffer, sustain, get

    Gold Raganato
  17. 17

    achieve a point or goal

    have%2:40:02:: · have.v.17

    • Nicklaus had a 70
    • The Brazilian team got 4 goals

    Synonyms: get, make

  18. 18

    cause to be born

    have%2:29:00:: · give_birth.v.01

    • My wife had twins yesterday!

    Synonyms: give birth, deliver, bear, birth

  19. 19

    have sex with; archaic use

    have%2:35:00:: · take.v.35

    • He had taken this woman when she was most vulnerable

    Synonyms: take

see Verb

Instance: semeval2015.d000.s020.t002 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

For more information, see the Summary of Product Characteristics (also part of the EPAR).

Show raw prompt

user

Which numbered sense of "see" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: For more information, <t>see</t> the Summary of Product Characteristics (also part of the EPAR).

Senses:
1. definition=perceive by sight or have the power to perceive by sight | examples=You have to be a good observer to see all the details
2. definition=perceive (an idea or situation) mentally | examples=Now I see!
3. definition=perceive or be contemporaneous with | examples=We found Republicans winning the offices
4. definition=imagine; conceive of; see in one's mind | examples=I can't see him on horseback!
5. definition=deem to be | examples=She views this quite differently from me
6. definition=get to know or become aware of, usually accidentally | examples=I learned that she has two grown-up children
7. definition=see or watch | examples=view a show on television
8. definition=come together | examples=I'll probably see you at the meeting
9. definition=find out, learn, or determine with certainty, usually by making an inquiry or other effort | examples=I want to see whether she speaks French
10. definition=be careful or certain to do something; make certain of something | examples=He verified that the valves were closed
11. definition=go to see for professional or business reasons | examples=You should see a lawyer
12. definition=go to see for a social visit | examples=I went to see my friend Mary the other day
13. definition=go to see a place, as for entertainment | examples=We went to see the Eiffel Tower in the morning
14. definition=take charge of or deal with | examples=Could you see about lunch?
15. definition=receive as a specified guest | examples=the doctor will see you now
16. definition=date regularly; have a steady relationship with | examples=Did you know that she is seeing an older man?
17. definition=see and understand, have a good eye | examples=The artist must first learn to see
18. definition=deliberate or decide | examples=See whether you can come tomorrow
19. definition=observe as if with an eye | examples=The camera saw the burglary and recorded it
20. definition=observe, check out, and look over carefully or inspect | examples=The customs agent examined the baggage
21. definition=go or live through | examples=We had many trials to go through
22. definition=accompany or escort | examples=I'll see you to the door
23. definition=match or meet | examples=I saw the bet of one of my fellow players
24. definition=make sense of; assign a meaning to | examples=What message do you see in this letter?

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    perceive by sight or have the power to perceive by sight

    see%2:39:00:: · see.v.01

    • You have to be a good observer to see all the details
    • Can you see the bird in that tree?
  2. 2

    perceive (an idea or situation) mentally

    see%2:31:01:: · understand.v.02

    • Now I see!
    • I just can't see your point

    Synonyms: understand, realize, realise

  3. 3

    perceive or be contemporaneous with

    see%2:39:02:: · witness.v.02

    • We found Republicans winning the offices
    • You'll see a lot of cheating in this school

    Synonyms: witness, find

  4. 4

    imagine; conceive of; see in one's mind

    see%2:36:00:: · visualize.v.01

    • I can't see him on horseback!
    • I can see what will happen

    Synonyms: visualize, visualise, envision, project, fancy, figure, picture, image

  5. 5

    deem to be

    see%2:31:00:: · see.v.05

    • She views this quite differently from me
    • I consider her to be shallow

    Synonyms: consider, reckon, view, regard

  6. 6

    get to know or become aware of, usually accidentally

    see%2:31:02:: · learn.v.02

    • I learned that she has two grown-up children
    • I see that you have been promoted

    Synonyms: learn, hear, get word, get wind, pick up, find out, get a line, discover

  7. 7

    see or watch

    see%2:39:03:: · watch.v.03

    • view a show on television
    • This program will be seen all over the world

    Synonyms: watch, view, catch, take in

  8. 8

    come together

    see%2:38:00:: · meet.v.01

    • I'll probably see you at the meeting
    • How nice to see you again!

    Synonyms: meet, run into, encounter, run across, come across

  9. 9

    find out, learn, or determine with certainty, usually by making an inquiry or other effort

    see%2:32:00:: · determine.v.08

    • I want to see whether she speaks French
    • See whether it works

    Synonyms: determine, check, find out, ascertain, watch, learn

    Selected
  10. 10

    be careful or certain to do something; make certain of something

    see%2:31:03:: · see.v.10

    • He verified that the valves were closed
    • See that the curtains are closed

    Synonyms: check, insure, see to it, ensure, control, ascertain, assure

  11. 11

    go to see for professional or business reasons

    see%2:41:11:: · see.v.11

    • You should see a lawyer
    • We had to see a psychiatrist
  12. 12

    go to see for a social visit

    see%2:41:12:: · see.v.12

    • I went to see my friend Mary the other day
  13. 13

    go to see a place, as for entertainment

    see%2:41:10:: · visit.v.01

    • We went to see the Eiffel Tower in the morning

    Synonyms: visit

  14. 14

    take charge of or deal with

    see%2:41:14:: · attend.v.02

    • Could you see about lunch?
    • I must attend to this matter

    Synonyms: attend, take care, look

  15. 15

    receive as a specified guest

    see%2:35:09:: · see.v.15

    • the doctor will see you now
    • The minister doesn't see anybody before noon
  16. 16

    date regularly; have a steady relationship with

    see%2:41:00:: · go_steady.v.01

    • Did you know that she is seeing an older man?
    • He is dating his former wife again!

    Synonyms: go steady, go out, date

  17. 17

    see and understand, have a good eye

    see%2:39:05:: · see.v.17

    • The artist must first learn to see
  18. 18

    deliberate or decide

    see%2:31:08:: · see.v.18

    • See whether you can come tomorrow
    • let's see--which movie should we see tonight?
  19. 19

    observe as if with an eye

    see%2:39:11:: · see.v.19

    • The camera saw the burglary and recorded it
  20. 20

    observe, check out, and look over carefully or inspect

    see%2:39:13:: · examine.v.02

    • The customs agent examined the baggage
    • I must see your passport before you can enter the country

    Synonyms: examine

    Gold lexEN Gold Maru 2022 Gold Raganato
  21. 21

    go or live through

    see%2:39:12:: · experience.v.01

    • We had many trials to go through
    • he saw action in Viet Nam

    Synonyms: experience, go through

  22. 22

    accompany or escort

    see%2:38:03:: · see.v.22

    • I'll see you to the door

    Synonyms: escort

  23. 23

    match or meet

    see%2:33:00:: · see.v.23

    • I saw the bet of one of my fellow players
  24. 24

    make sense of; assign a meaning to

    see%2:31:13:: · interpret.v.01

    • What message do you see in this letter?
    • How do you interpret his behavior?

    Synonyms: interpret, construe

convert Verb

Instance: semeval2015.d000.s023.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Show raw prompt

user

Which numbered sense of "convert" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: In the body, pemetrexed is <t>converted</t> into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Senses:
1. definition=change from one system to another or to a new plan or policy | examples=We converted from 220 to 110 Volt
2. definition=change the nature, purpose, or function of something | examples=convert lead into gold
3. definition=change religious beliefs, or adopt a religious belief | examples=She converted to Buddhism
4. definition=exchange or replace with another, usually of the same kind or category | examples=Could you convert my dollars into pounds?
5. definition=cause to adopt a new or different faith | examples=The missionaries converted the Indian population
6. definition=score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone | examples=Smith converted and his team won
7. definition=complete successfully | examples=score a penalty shot or free throw
8. definition=score (a spare)
9. definition=make (someone) agree, understand, or realize the truth or validity of something | examples=He had finally convinced several customers of the advantages of his product
10. definition=exchange a penalty for a less severe one
11. definition=change in nature, purpose, or function; undergo a chemical change | examples=The substance converts to an acid

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    change from one system to another or to a new plan or policy

    convert%2:30:00:: · convert.v.01

    • We converted from 220 to 110 Volt

    Synonyms: change over

  2. 2

    change the nature, purpose, or function of something

    convert%2:30:03:: · convert.v.02

    • convert lead into gold
    • convert hotels into jails
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    change religious beliefs, or adopt a religious belief

    convert%2:30:01:: · convert.v.03

    • She converted to Buddhism
  4. 4

    exchange or replace with another, usually of the same kind or category

    convert%2:30:02:: · change.v.06

    • Could you convert my dollars into pounds?
    • He changed his name

    Synonyms: change, exchange, commute

  5. 5

    cause to adopt a new or different faith

    convert%2:30:07:: · convert.v.05

    • The missionaries converted the Indian population
  6. 6

    score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone

    convert%2:33:02:: · convert.v.06

    • Smith converted and his team won
  7. 7

    complete successfully

    convert%2:33:01:: · convert.v.07

    • score a penalty shot or free throw
  8. 8

    score (a spare)

    convert%2:33:00:: · convert.v.08

  9. 9

    make (someone) agree, understand, or realize the truth or validity of something

    convert%2:32:00:: · convert.v.09

    • He had finally convinced several customers of the advantages of his product

    Synonyms: win over, convince

  10. 10

    exchange a penalty for a less severe one

    convert%2:30:09:: · commute.v.04

    Synonyms: commute, exchange

  11. 11

    change in nature, purpose, or function; undergo a chemical change

    convert%2:30:04:: · convert.v.11

    • The substance converts to an acid
    Gold Raganato Selected

block Verb

Instance: semeval2015.d000.s023.t004 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Show raw prompt

user

Which numbered sense of "block" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: In the body, pemetrexed is converted into an active form that <t>blocks</t> the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Senses:
1. definition=render unsuitable for passage | examples=block the way
2. definition=hinder or prevent the progress or accomplishment of | examples=His brother blocked him at every turn
3. definition=stop from happening or developing | examples=Block his election
4. definition=interfere with or prevent the reception of signals | examples=Jam the Voice of America
5. definition=run on a block system | examples=block trains
6. definition=interrupt the normal function of by means of anesthesia | examples=block a nerve
7. definition=shut out from view or get in the way so as to hide from sight | examples=The thick curtain blocked the action on the stage
8. definition=stamp or emboss a title or design on a book with a block | examples=block the book cover
9. definition=obstruct | examples=My nose is all stuffed
10. definition=block passage through | examples=obstruct the path
11. definition=support, secure, or raise with a block | examples=block a plate for printing
12. definition=impede the movement of (an opponent or a ball) | examples=block an attack
13. definition=be unable to remember | examples=I'm drawing a blank
14. definition=shape by using a block | examples=Block a hat
15. definition=shape into a block or blocks | examples=block the graphs so one can see the results clearly
16. definition=prohibit the conversion or use of (assets) | examples=Blocked funds

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    render unsuitable for passage

    block%2:35:00:: · barricade.v.01

    • block the way
    • barricade the streets

    Synonyms: barricade, blockade, stop, block off, block up, bar

  2. 2

    hinder or prevent the progress or accomplishment of

    block%2:41:00:: · obstruct.v.01

    • His brother blocked him at every turn

    Synonyms: obstruct, blockade, hinder, stymie, stymy, embarrass

    Selected
  3. 3

    stop from happening or developing

    block%2:41:01:: · stop.v.03

    • Block his election
    • Halt the process

    Synonyms: stop, halt, kibosh

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    interfere with or prevent the reception of signals

    block%2:32:00:: · jam.v.04

    • Jam the Voice of America
    • block the signals emitted by this station

    Synonyms: jam

  5. 5

    run on a block system

    block%2:41:03:: · block.v.05

    • block trains
  6. 6

    interrupt the normal function of by means of anesthesia

    block%2:39:05:: · block.v.06

    • block a nerve
    • block a muscle
  7. 7

    shut out from view or get in the way so as to hide from sight

    block%2:39:00:: · obstruct.v.03

    • The thick curtain blocked the action on the stage
    • The trees obstruct my view of the mountains

    Synonyms: obstruct

  8. 8

    stamp or emboss a title or design on a book with a block

    block%2:35:03:: · block.v.08

    • block the book cover
  9. 9

    obstruct

    block%2:35:02:: · stuff.v.03

    • My nose is all stuffed
    • Her arteries are blocked

    Synonyms: stuff, lug, choke up

  10. 10

    block passage through

    block%2:35:12:: · obstruct.v.02

    • obstruct the path

    Synonyms: obstruct, obturate, impede, occlude, jam, close up

  11. 11

    support, secure, or raise with a block

    block%2:35:06:: · block.v.11

    • block a plate for printing
    • block the wheels of a car
  12. 12

    impede the movement of (an opponent or a ball)

    block%2:33:00:: · parry.v.01

    • block an attack

    Synonyms: parry, deflect

  13. 13

    be unable to remember

    block%2:31:00:: · forget.v.02

    • I'm drawing a blank
    • You are blocking the name of your first wife!

    Synonyms: forget, blank out, draw a blank

  14. 14

    shape by using a block

    block%2:30:01:: · block.v.14

    • Block a hat
    • block a garment
  15. 15

    shape into a block or blocks

    block%2:30:00:: · block.v.15

    • block the graphs so one can see the results clearly
  16. 16

    prohibit the conversion or use of (assets)

    block%2:30:02:: · freeze.v.08

    • Blocked funds
    • Freeze the assets of this hostile government

    Synonyms: freeze, immobilize, immobilise

survive Verb

Instance: semeval2015.d000.s029.t006 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

In all three studies, the main measure of effectiveness was how long the patients survived.

Show raw prompt

user

Which numbered sense of "survive" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: In all three studies, the main measure of effectiveness was how long the patients <t>survived</t>.

Senses:
1. definition=continue to live through hardship or adversity | examples=We went without water and food for 3 days
2. definition=continue in existence after (an adversity, etc.) | examples=He survived the cancer against all odds
3. definition=support oneself | examples=he could barely exist on such a low wage
4. definition=live longer than | examples=She outlived her husband by many years

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    continue to live through hardship or adversity

    survive%2:42:01:: · survive.v.01

    • We went without water and food for 3 days
    • These superstitions survive in the backwaters of America

    Synonyms: last, live, live on, go, endure, hold up, hold out

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    continue in existence after (an adversity, etc.)

    survive%2:42:02:: · survive.v.02

    • He survived the cancer against all odds

    Synonyms: pull through, pull round, come through, make it

    Gold Raganato Selected
  3. 3

    support oneself

    survive%2:42:00:: · exist.v.02

    • he could barely exist on such a low wage
    • Can you live on $2000 a month in New York City?

    Synonyms: exist, live, subsist

  4. 4

    live longer than

    survive%2:42:03:: · outlive.v.01

    • She outlived her husband by many years

    Synonyms: outlive, outlast

affect Verb

Instance: semeval2015.d000.s036.t005 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

However, in both studies, patients whose cancer was not affecting squamous cells had longer survival times if they received Alimta than if they received the comparator.

Show raw prompt

user

Which numbered sense of "affect" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: However, in both studies, patients whose cancer was not <t>affecting</t> squamous cells had longer survival times if they received Alimta than if they received the comparator.

Senses:
1. definition=have an effect upon | examples=Will the new rules affect me?
2. definition=act physically on; have an effect upon | examples=the medicine affects my heart rate
3. definition=connect closely and often incriminatingly | examples=This new ruling affects your business
4. definition=make believe with the intent to deceive | examples=He feigned that he was ill
5. definition=have an emotional or cognitive impact upon | examples=This child impressed me as unusually mature

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    have an effect upon

    affect%2:30:00:: · affect.v.01

    • Will the new rules affect me?

    Synonyms: impact, bear upon, bear on, touch on, touch

    Selected
  2. 2

    act physically on; have an effect upon

    affect%2:29:00:: · affect.v.02

    • the medicine affects my heart rate
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    connect closely and often incriminatingly

    affect%2:42:00:: · involve.v.01

    • This new ruling affects your business

    Synonyms: involve, regard

  4. 4

    make believe with the intent to deceive

    affect%2:32:00:: · feign.v.01

    • He feigned that he was ill
    • He shammed a headache

    Synonyms: feign, sham, pretend, dissemble

  5. 5

    have an emotional or cognitive impact upon

    affect%2:37:00:: · affect.v.05

    • This child impressed me as unusually mature
    • This behavior struck me as odd

    Synonyms: impress, move, strike

affect Verb

Instance: semeval2015.d000.s037.t003 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

In contrast, patients whose cancer was affecting squamous cells had shorter survival times if they received Alimta.

Show raw prompt

user

Which numbered sense of "affect" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: In contrast, patients whose cancer was <t>affecting</t> squamous cells had shorter survival times if they received Alimta.

Senses:
1. definition=have an effect upon | examples=Will the new rules affect me?
2. definition=act physically on; have an effect upon | examples=the medicine affects my heart rate
3. definition=connect closely and often incriminatingly | examples=This new ruling affects your business
4. definition=make believe with the intent to deceive | examples=He feigned that he was ill
5. definition=have an emotional or cognitive impact upon | examples=This child impressed me as unusually mature

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    have an effect upon

    affect%2:30:00:: · affect.v.01

    • Will the new rules affect me?

    Synonyms: impact, bear upon, bear on, touch on, touch

    Selected
  2. 2

    act physically on; have an effect upon

    affect%2:29:00:: · affect.v.02

    • the medicine affects my heart rate
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    connect closely and often incriminatingly

    affect%2:42:00:: · involve.v.01

    • This new ruling affects your business

    Synonyms: involve, regard

  4. 4

    make believe with the intent to deceive

    affect%2:32:00:: · feign.v.01

    • He feigned that he was ill
    • He shammed a headache

    Synonyms: feign, sham, pretend, dissemble

  5. 5

    have an emotional or cognitive impact upon

    affect%2:37:00:: · affect.v.05

    • This child impressed me as unusually mature
    • This behavior struck me as odd

    Synonyms: impress, move, strike

know Verb

Instance: semeval2015.d001.s002.t003 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

It is actually not necessary to know MathML to use kalgebra.

Show raw prompt

user

Which numbered sense of "know" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: It is actually not necessary to <t>know</t> MathML to use kalgebra.

Senses:
1. definition=be cognizant or aware of a fact or a specific piece of information; possess knowledge or information about | examples=I know that the President lied to the people
2. definition=know how to do or perform something | examples=She knows how to knit
3. definition=be aware of the truth of something; have a belief or faith in something; regard as true beyond any doubt | examples=I know that I left the key on the table
4. definition=be familiar or acquainted with a person or an object | examples=She doesn't know this composer
5. definition=have firsthand knowledge of states, situations, emotions, or sensations | examples=I know the feeling!
6. definition=accept (someone) to be what is claimed or accept his power and authority | examples=The Crown Prince was acknowledged as the true heir to the throne
7. definition=have fixed in the mind | examples=I know Latin
8. definition=have sexual intercourse with | examples=This student sleeps with everyone in her dorm
9. definition=know the nature or character of | examples=we all knew her as a big show-off
10. definition=be able to distinguish, recognize as being different | examples=The child knows right from wrong
11. definition=perceive as familiar | examples=I know this voice!

Prediction matches gold: lexEN ✗ Maru 2022 ✓ Raganato ✗

WordNet 3.0 senses

  1. 1

    be cognizant or aware of a fact or a specific piece of information; possess knowledge or information about

    know%2:31:01:: · know.v.01

    • I know that the President lied to the people
    • I want to know who is winning the game!

    Synonyms: cognize, cognise

    Gold Raganato
  2. 2

    know how to do or perform something

    know%2:31:03:: · know.v.02

    • She knows how to knit
    • Does your husband know how to cook?
    Gold Maru 2022 Selected
  3. 3

    be aware of the truth of something; have a belief or faith in something; regard as true beyond any doubt

    know%2:31:02:: · know.v.03

    • I know that I left the key on the table
    • Galileo knew that the earth moves around the sun
  4. 4

    be familiar or acquainted with a person or an object

    know%2:31:00:: · know.v.04

    • She doesn't know this composer
    • Do you know my sister?
    Gold Raganato
  5. 5

    have firsthand knowledge of states, situations, emotions, or sensations

    know%2:31:04:: · know.v.05

    • I know the feeling!
    • have you ever known hunger?

    Synonyms: experience, live

  6. 6

    accept (someone) to be what is claimed or accept his power and authority

    know%2:31:06:: · acknowledge.v.06

    • The Crown Prince was acknowledged as the true heir to the throne
    • We do not recognize your gods

    Synonyms: acknowledge, recognize, recognise

  7. 7

    have fixed in the mind

    know%2:31:15:: · know.v.07

    • I know Latin
    • This student knows her irregular verbs
    Gold lexEN
  8. 8

    have sexual intercourse with

    know%2:35:00:: · sleep_together.v.01

    • This student sleeps with everyone in her dorm
    • Adam knew Eve

    Synonyms: sleep together, roll in the hay, love, make out, make love, sleep with, get laid, have sex, do it, be intimate, have intercourse, have it away, have it off, screw, fuck, jazz, eff, hump, lie with, bed, have a go at it, bang, get it on, bonk

  9. 9

    know the nature or character of

    know%2:31:11:: · know.v.09

    • we all knew her as a big show-off
  10. 10

    be able to distinguish, recognize as being different

    know%2:31:12:: · know.v.10

    • The child knows right from wrong
  11. 11

    perceive as familiar

    know%2:31:14:: · know.v.11

    • I know this voice!