Verified run

openrouter/z-ai/glm-5

glm-5-low-reasoning-p002-lexen-v1-20260614

Rank
44
Accuracy lexEN v1 · WordNet fine
92.22%
Correct
4483 / 4861
Actual run cost
$15.78
Cost / M items
$3,246

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 92.22% 4483 / 4861 97.28% 4729 / 4861 94.92% 4614 / 4861
Maru 2022 (ALLamended) 89.82% 4366 / 4861 96.44% 4688 / 4861 93.46% 4543 / 4861
Raganato 2017 (original) 83.58% 4063 / 4861 93.54% 4547 / 4861 89.53% 4352 / 4861

Model

Display
openrouter/z-ai/glm-5
Requested
openrouter/z-ai/glm-5
Resolved
z-ai/glm-5-20260211
Vendor
Z.ai
API provider
OpenRouter
Hosting
cloud_api
Source
open_source
License
n/a
Reasoning
low
Model URL
n/a
Endpoint
n/a
Resolved counts
z-ai/glm-5-20260211: 4986

Reproducibility

Created
2026-06-14T19:49:03.779025+00:00
Run schema
sensebench-run-v2
Commit
fd80e685c1b59fa715c54dc8c0978694af31026a
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p002
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4986
Total tokens
12,101,888
Tokens / item
2,489.6
Total cost
$15.78
Cost / M items
$3,246
Cost source
provider_reported
Elapsed
40.71m
Success items
4,858
Monosemous
0
No candidates
0
No valid vote
3
Invalid votes
3
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
8,192
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $15.78. Cost estimate source: provider_reported.

Token Type Tokens Cost Price / 1M tokens
Input uncached 1,129,085 $0.986 n/a
Input cached 20,352 n/a n/a
Output 5,420,205 $14.80 n/a
Reasoning output 5,532,246 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 89.42% 710 794
Candidate Count 2 96.26% 823 855
Candidate Count 3-5 93.06% 1810 1945
Candidate Count 6-10 89.98% 1140 1267
POS ADJ 95.14% 627 659
POS ADV 89.23% 174 195
POS NOUN 92.99% 2694 2897
POS VERB 89.01% 988 1110
Source Dataset semeval2013 93.77% 1069 1140
Source Dataset semeval2015 92.56% 684 739
Source Dataset senseval2 91.77% 1495 1629
Source Dataset senseval3 91.28% 1235 1353

Worst-Bucket Examples

take_advantage Verb

Instance: semeval2013.d006.s012.t004 Dataset: semeval2013 Bucket: POS / VERB

Incorrect

Another of these advantages to which it is alluded to with the fare-play is to avoid that the team of the lawbreaker players takes advantage unjustly of the opposite team, which did not happen either.

Show raw prompt

user

Which numbered sense of "take_advantage" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Another of these advantages to which it is alluded to with the fare-play is to avoid that the team of the lawbreaker players <t>takes advantage</t> unjustly of the opposite team, which did not happen either.

Senses:
1. definition=draw advantages from | examples=he is capitalizing on her mistake
2. definition=make excessive use of | examples=You are taking advantage of my good will!

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    draw advantages from

    take_advantage%2:40:00:: · capitalize.v.01

    • he is capitalizing on her mistake
    • she took advantage of his absence to meet her lover

    Synonyms: capitalize, capitalise

    Gold lexEN Gold Maru 2022
  2. 2

    make excessive use of

    take_advantage%2:41:12:: · trespass.v.02

    • You are taking advantage of my good will!
    • She is trespassing upon my privacy

    Synonyms: trespass

    Selected

drip Verb

Instance: semeval2015.d000.s005.t004 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Alimta is a powder that is made up into a solution for infusion (drip into a vein).

Show raw prompt

user

Which numbered sense of "drip" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Alimta is a powder that is made up into a solution for infusion (<t>drip</t> into a vein).

Senses:
1. definition=fall in drops | examples=Water is dripping from the faucet
2. definition=let or cause to fall in drops | examples=dribble oil into the mixture

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    fall in drops

    drip%2:38:00:: · drip.v.01

    • Water is dripping from the faucet
    Selected
  2. 2

    let or cause to fall in drops

    drip%2:35:10:: · dribble.v.02

    • dribble oil into the mixture

    Synonyms: dribble, drop

    Gold lexEN Gold Maru 2022 Gold Raganato

delay Verb

Instance: semeval2015.d000.s018.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Show raw prompt

user

Which numbered sense of "delay" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Treatment should be <t>delayed</t> or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Senses:
1. definition=cause to be slowed down or delayed | examples=Traffic was delayed by the bad weather
2. definition=act later than planned, scheduled, or required | examples=Don't delay your application to graduate school or else it won't be considered
3. definition=stop or halt | examples=Please stay the bloodshed!
4. definition=slow the growth or development of | examples=The brain damage will retard the child's language development

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    cause to be slowed down or delayed

    delay%2:30:00:: · delay.v.01

    • Traffic was delayed by the bad weather
    • she delayed the work that she didn't want to perform

    Synonyms: detain, hold up

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    act later than planned, scheduled, or required

    delay%2:42:00:: · delay.v.02

    • Don't delay your application to graduate school or else it won't be considered
    Gold Raganato Selected
  3. 3

    stop or halt

    delay%2:30:01:: · stay.v.06

    • Please stay the bloodshed!

    Synonyms: stay, detain

  4. 4

    slow the growth or development of

    delay%2:30:05:: · check.v.07

    • The brain damage will retard the child's language development

    Synonyms: check, retard

have Verb

Instance: semeval2015.d000.s018.t008 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who have certain other side effects.

Show raw prompt

user

Which numbered sense of "have" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Treatment should be delayed or discontinued, or the dose reduced, in patients whose blood counts are abnormal or who <t>have</t> certain other side effects.

Senses:
1. definition=have or possess, either in a concrete or an abstract sense | examples=She has $1,000 in the bank
2. definition=have as a feature | examples=This restaurant features the most famous chefs in France
3. definition=go through (mental or physical states or experiences) | examples=get an idea
4. definition=have ownership or possession of | examples=He owns three houses in Florida
5. definition=cause to move; cause to be in a certain position or condition | examples=He got his squad on the ball
6. definition=serve oneself to, or consume regularly | examples=Have another bowl of chicken soup!
7. definition=have a personal or business relationship with someone | examples=have a postdoc
8. definition=organize or be responsible for | examples=hold a reception
9. definition=have left | examples=I have two years left
10. definition=be confronted with | examples=What do we have here?
11. definition=undergo | examples=The stocks had a fast run-up
12. definition=suffer from; be ill with | examples=She has arthritis
13. definition=cause to do; cause to act in a specified manner | examples=The ads induced me to buy a VCR
14. definition=receive willingly something given or offered | examples=The only girl who would have him was the miller's daughter
15. definition=get something; come into possession of | examples=receive payment
16. definition=undergo (as of injuries and illnesses) | examples=She suffered a fracture in the accident
17. definition=achieve a point or goal | examples=Nicklaus had a 70
18. definition=cause to be born | examples=My wife had twins yesterday!
19. definition=have sex with; archaic use | examples=He had taken this woman when she was most vulnerable

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    have or possess, either in a concrete or an abstract sense

    have%2:40:00:: · have.v.01

    • She has $1,000 in the bank
    • He has got two beautiful daughters

    Synonyms: have got, hold

  2. 2

    have as a feature

    have%2:42:00:: · have.v.02

    • This restaurant features the most famous chefs in France

    Synonyms: feature

  3. 3

    go through (mental or physical states or experiences)

    have%2:39:06:: · experience.v.03

    • get an idea
    • experience vertigo

    Synonyms: experience, receive, get

    Gold lexEN Gold Maru 2022
  4. 4

    have ownership or possession of

    have%2:40:04:: · own.v.01

    • He owns three houses in Florida
    • How many cars does she have?

    Synonyms: own, possess

  5. 5

    cause to move; cause to be in a certain position or condition

    have%2:30:00:: · get.v.03

    • He got his squad on the ball
    • This let me in for a big surprise

    Synonyms: get, let

  6. 6

    serve oneself to, or consume regularly

    have%2:34:00:: · consume.v.02

    • Have another bowl of chicken soup!
    • I don't take sugar in my coffee

    Synonyms: consume, ingest, take in, take

  7. 7

    have a personal or business relationship with someone

    have%2:41:00:: · have.v.07

    • have a postdoc
    • have an assistant
  8. 8

    organize or be responsible for

    have%2:36:00:: · hold.v.03

    • hold a reception
    • have, throw, or make a party

    Synonyms: hold, throw, make, give

  9. 9

    have left

    have%2:40:01:: · have.v.09

    • I have two years left
    • I don't have any money left
  10. 10

    be confronted with

    have%2:42:12:: · have.v.10

    • What do we have here?
    • Now we have a fine mess
  11. 11

    undergo

    have%2:30:01:: · have.v.11

    • The stocks had a fast run-up

    Synonyms: experience

    Gold lexEN Gold Maru 2022
  12. 12

    suffer from; be ill with

    have%2:29:02:: · have.v.12

    • She has arthritis
    Gold Raganato Selected
  13. 13

    cause to do; cause to act in a specified manner

    have%2:32:00:: · induce.v.02

    • The ads induced me to buy a VCR
    • My children finally got me to buy a computer

    Synonyms: induce, stimulate, cause, get, make

  14. 14

    receive willingly something given or offered

    have%2:40:05:: · accept.v.02

    • The only girl who would have him was the miller's daughter
    • I won't have this dog in my house!

    Synonyms: accept, take

  15. 15

    get something; come into possession of

    have%2:40:03:: · receive.v.01

    • receive payment
    • receive a gift

    Synonyms: receive

  16. 16

    undergo (as of injuries and illnesses)

    have%2:29:05:: · suffer.v.02

    • She suffered a fracture in the accident
    • He had an insulin shock after eating three candy bars

    Synonyms: suffer, sustain, get

    Gold Raganato
  17. 17

    achieve a point or goal

    have%2:40:02:: · have.v.17

    • Nicklaus had a 70
    • The Brazilian team got 4 goals

    Synonyms: get, make

  18. 18

    cause to be born

    have%2:29:00:: · give_birth.v.01

    • My wife had twins yesterday!

    Synonyms: give birth, deliver, bear, birth

  19. 19

    have sex with; archaic use

    have%2:35:00:: · take.v.35

    • He had taken this woman when she was most vulnerable

    Synonyms: take

convert Verb

Instance: semeval2015.d000.s023.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Show raw prompt

user

Which numbered sense of "convert" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: In the body, pemetrexed is <t>converted</t> into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Senses:
1. definition=change from one system to another or to a new plan or policy | examples=We converted from 220 to 110 Volt
2. definition=change the nature, purpose, or function of something | examples=convert lead into gold
3. definition=change religious beliefs, or adopt a religious belief | examples=She converted to Buddhism
4. definition=exchange or replace with another, usually of the same kind or category | examples=Could you convert my dollars into pounds?
5. definition=cause to adopt a new or different faith | examples=The missionaries converted the Indian population
6. definition=score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone | examples=Smith converted and his team won
7. definition=complete successfully | examples=score a penalty shot or free throw
8. definition=score (a spare)
9. definition=make (someone) agree, understand, or realize the truth or validity of something | examples=He had finally convinced several customers of the advantages of his product
10. definition=exchange a penalty for a less severe one
11. definition=change in nature, purpose, or function; undergo a chemical change | examples=The substance converts to an acid

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    change from one system to another or to a new plan or policy

    convert%2:30:00:: · convert.v.01

    • We converted from 220 to 110 Volt

    Synonyms: change over

  2. 2

    change the nature, purpose, or function of something

    convert%2:30:03:: · convert.v.02

    • convert lead into gold
    • convert hotels into jails
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    change religious beliefs, or adopt a religious belief

    convert%2:30:01:: · convert.v.03

    • She converted to Buddhism
  4. 4

    exchange or replace with another, usually of the same kind or category

    convert%2:30:02:: · change.v.06

    • Could you convert my dollars into pounds?
    • He changed his name

    Synonyms: change, exchange, commute

  5. 5

    cause to adopt a new or different faith

    convert%2:30:07:: · convert.v.05

    • The missionaries converted the Indian population
  6. 6

    score an extra point or points after touchdown by kicking the ball through the uprights or advancing the ball into the end zone

    convert%2:33:02:: · convert.v.06

    • Smith converted and his team won
  7. 7

    complete successfully

    convert%2:33:01:: · convert.v.07

    • score a penalty shot or free throw
  8. 8

    score (a spare)

    convert%2:33:00:: · convert.v.08

  9. 9

    make (someone) agree, understand, or realize the truth or validity of something

    convert%2:32:00:: · convert.v.09

    • He had finally convinced several customers of the advantages of his product

    Synonyms: win over, convince

  10. 10

    exchange a penalty for a less severe one

    convert%2:30:09:: · commute.v.04

    Synonyms: commute, exchange

  11. 11

    change in nature, purpose, or function; undergo a chemical change

    convert%2:30:04:: · convert.v.11

    • The substance converts to an acid
    Gold Raganato Selected

block Verb

Instance: semeval2015.d000.s023.t004 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

In the body, pemetrexed is converted into an active form that blocks the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Show raw prompt

user

Which numbered sense of "block" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: In the body, pemetrexed is converted into an active form that <t>blocks</t> the activity of the enzymes that are involved in producing nucleotides (the building blocks of DNA and RNA, the genetic material of cells).

Senses:
1. definition=render unsuitable for passage | examples=block the way
2. definition=hinder or prevent the progress or accomplishment of | examples=His brother blocked him at every turn
3. definition=stop from happening or developing | examples=Block his election
4. definition=interfere with or prevent the reception of signals | examples=Jam the Voice of America
5. definition=run on a block system | examples=block trains
6. definition=interrupt the normal function of by means of anesthesia | examples=block a nerve
7. definition=shut out from view or get in the way so as to hide from sight | examples=The thick curtain blocked the action on the stage
8. definition=stamp or emboss a title or design on a book with a block | examples=block the book cover
9. definition=obstruct | examples=My nose is all stuffed
10. definition=block passage through | examples=obstruct the path
11. definition=support, secure, or raise with a block | examples=block a plate for printing
12. definition=impede the movement of (an opponent or a ball) | examples=block an attack
13. definition=be unable to remember | examples=I'm drawing a blank
14. definition=shape by using a block | examples=Block a hat
15. definition=shape into a block or blocks | examples=block the graphs so one can see the results clearly
16. definition=prohibit the conversion or use of (assets) | examples=Blocked funds

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    render unsuitable for passage

    block%2:35:00:: · barricade.v.01

    • block the way
    • barricade the streets

    Synonyms: barricade, blockade, stop, block off, block up, bar

  2. 2

    hinder or prevent the progress or accomplishment of

    block%2:41:00:: · obstruct.v.01

    • His brother blocked him at every turn

    Synonyms: obstruct, blockade, hinder, stymie, stymy, embarrass

    Selected
  3. 3

    stop from happening or developing

    block%2:41:01:: · stop.v.03

    • Block his election
    • Halt the process

    Synonyms: stop, halt, kibosh

    Gold lexEN Gold Maru 2022 Gold Raganato
  4. 4

    interfere with or prevent the reception of signals

    block%2:32:00:: · jam.v.04

    • Jam the Voice of America
    • block the signals emitted by this station

    Synonyms: jam

  5. 5

    run on a block system

    block%2:41:03:: · block.v.05

    • block trains
  6. 6

    interrupt the normal function of by means of anesthesia

    block%2:39:05:: · block.v.06

    • block a nerve
    • block a muscle
  7. 7

    shut out from view or get in the way so as to hide from sight

    block%2:39:00:: · obstruct.v.03

    • The thick curtain blocked the action on the stage
    • The trees obstruct my view of the mountains

    Synonyms: obstruct

  8. 8

    stamp or emboss a title or design on a book with a block

    block%2:35:03:: · block.v.08

    • block the book cover
  9. 9

    obstruct

    block%2:35:02:: · stuff.v.03

    • My nose is all stuffed
    • Her arteries are blocked

    Synonyms: stuff, lug, choke up

  10. 10

    block passage through

    block%2:35:12:: · obstruct.v.02

    • obstruct the path

    Synonyms: obstruct, obturate, impede, occlude, jam, close up

  11. 11

    support, secure, or raise with a block

    block%2:35:06:: · block.v.11

    • block a plate for printing
    • block the wheels of a car
  12. 12

    impede the movement of (an opponent or a ball)

    block%2:33:00:: · parry.v.01

    • block an attack

    Synonyms: parry, deflect

  13. 13

    be unable to remember

    block%2:31:00:: · forget.v.02

    • I'm drawing a blank
    • You are blocking the name of your first wife!

    Synonyms: forget, blank out, draw a blank

  14. 14

    shape by using a block

    block%2:30:01:: · block.v.14

    • Block a hat
    • block a garment
  15. 15

    shape into a block or blocks

    block%2:30:00:: · block.v.15

    • block the graphs so one can see the results clearly
  16. 16

    prohibit the conversion or use of (assets)

    block%2:30:02:: · freeze.v.08

    • Blocked funds
    • Freeze the assets of this hostile government

    Synonyms: freeze, immobilize, immobilise

involve Verb

Instance: semeval2015.d000.s027.t008 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study involving 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Show raw prompt

user

Which numbered sense of "involve" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: For the treatment of non-small cell lung cancer, the effects of Alimta were compared with those of docetaxel (another anticancer medicine) in one study <t>involving</t> 571 patients with locally advanced or metastatic disease who had received chemotherapy in the past.

Senses:
1. definition=connect closely and often incriminatingly | examples=This new ruling affects your business
2. definition=engage as a participant | examples=Don't involve me in your family affairs!
3. definition=have as a necessary feature | examples=This decision involves many changes
4. definition=require as useful, just, or proper | examples=It takes nerve to do what she did
5. definition=contain as a part | examples=Dinner at Joe's always involves at least six courses
6. definition=occupy or engage the interest of | examples=His story completely involved me during the entire afternoon
7. definition=make complex or intricate or complicated | examples=The situation was rather involved

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    connect closely and often incriminatingly

    involve%2:42:01:: · involve.v.01

    • This new ruling affects your business

    Synonyms: affect, regard

  2. 2

    engage as a participant

    involve%2:42:04:: · involve.v.02

    • Don't involve me in your family affairs!
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    have as a necessary feature

    involve%2:42:00:: · imply.v.05

    • This decision involves many changes

    Synonyms: imply

  4. 4

    require as useful, just, or proper

    involve%2:42:07:: · necessitate.v.01

    • It takes nerve to do what she did
    • success usually requires hard work

    Synonyms: necessitate, ask, postulate, need, require, take, call for, demand

  5. 5

    contain as a part

    involve%2:42:02:: · involve.v.05

    • Dinner at Joe's always involves at least six courses
    Selected
  6. 6

    occupy or engage the interest of

    involve%2:31:00:: · involve.v.06

    • His story completely involved me during the entire afternoon
  7. 7

    make complex or intricate or complicated

    involve%2:30:00:: · involve.v.07

    • The situation was rather involved

involve Verb

Instance: semeval2015.d000.s028.t006 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study involving 1,725 patients who had not received chemotherapy for lung cancer in the past.

Show raw prompt

user

Which numbered sense of "involve" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Alimta was also compared with gemcitabine (another anticancer medicine), both in combination with cisplatin, in a study <t>involving</t> 1,725 patients who had not received chemotherapy for lung cancer in the past.

Senses:
1. definition=connect closely and often incriminatingly | examples=This new ruling affects your business
2. definition=engage as a participant | examples=Don't involve me in your family affairs!
3. definition=have as a necessary feature | examples=This decision involves many changes
4. definition=require as useful, just, or proper | examples=It takes nerve to do what she did
5. definition=contain as a part | examples=Dinner at Joe's always involves at least six courses
6. definition=occupy or engage the interest of | examples=His story completely involved me during the entire afternoon
7. definition=make complex or intricate or complicated | examples=The situation was rather involved

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    connect closely and often incriminatingly

    involve%2:42:01:: · involve.v.01

    • This new ruling affects your business

    Synonyms: affect, regard

  2. 2

    engage as a participant

    involve%2:42:04:: · involve.v.02

    • Don't involve me in your family affairs!
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    have as a necessary feature

    involve%2:42:00:: · imply.v.05

    • This decision involves many changes

    Synonyms: imply

  4. 4

    require as useful, just, or proper

    involve%2:42:07:: · necessitate.v.01

    • It takes nerve to do what she did
    • success usually requires hard work

    Synonyms: necessitate, ask, postulate, need, require, take, call for, demand

  5. 5

    contain as a part

    involve%2:42:02:: · involve.v.05

    • Dinner at Joe's always involves at least six courses
    Selected
  6. 6

    occupy or engage the interest of

    involve%2:31:00:: · involve.v.06

    • His story completely involved me during the entire afternoon
  7. 7

    make complex or intricate or complicated

    involve%2:30:00:: · involve.v.07

    • The situation was rather involved

consist Verb

Instance: semeval2015.d001.s007.t002 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

kalgebra main window consists in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab.

Show raw prompt

user

Which numbered sense of "consist" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: kalgebra main window <t>consists</t> in a Console tab, a 2D Graph tab, a 3D Graph tab and a Dictionary tab.

Senses:
1. definition=originate (in) | examples=The problems dwell in the social injustices in this country
2. definition=have its essential character; be comprised or contained in; be embodied in | examples=The payment consists in food
3. definition=be consistent in form, tenor, or character; be congruous | examples=Desires are to be satisfied only so far as consists with an approved end
4. definition=be composed of | examples=The land he conquered comprised several provinces

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    originate (in)

    consist%2:42:00:: · dwell.v.02

    • The problems dwell in the social injustices in this country

    Synonyms: dwell, lie, lie in

  2. 2

    have its essential character; be comprised or contained in; be embodied in

    consist%2:42:04:: · consist.v.02

    • The payment consists in food
    • What does love consist in?
    Selected
  3. 3

    be consistent in form, tenor, or character; be congruous

    consist%2:42:02:: · consist.v.03

    • Desires are to be satisfied only so far as consists with an approved end
  4. 4

    be composed of

    consist%2:42:01:: · consist.v.04

    • The land he conquered comprised several provinces
    • What does this dish consist of?

    Synonyms: comprise

    Gold lexEN Gold Maru 2022 Gold Raganato

find Verb

Instance: semeval2015.d001.s008.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

Below these tabs you will find an input field to type your functions or do your calculations.

Show raw prompt

user

Which numbered sense of "find" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Below these tabs you will <t>find</t> an input field to type your functions or do your calculations.

Senses:
1. definition=come upon, as if by accident; meet with | examples=We find this idea in Plato
2. definition=discover or determine the existence, presence, or fact of | examples=She detected high levels of lead in her drinking water
3. definition=come upon after searching; find the location of something that was missed or lost | examples=Did you find your glasses?
4. definition=establish after a calculation, investigation, experiment, survey, or study | examples=find the product of two numbers
5. definition=come to believe on the basis of emotion, intuitions, or indefinite grounds | examples=I feel that he doesn't like me
6. definition=perceive or be contemporaneous with | examples=We found Republicans winning the offices
7. definition=get something or somebody for a specific purpose | examples=I found this gadget that will serve as a bottle opener
8. definition=make a discovery, make a new finding | examples=Roentgen discovered X-rays
9. definition=make a discovery | examples=She found that he had lied to her
10. definition=obtain through effort or management | examples=She found the time and energy to take care of her aging parents
11. definition=decide on and make a declaration about | examples=find someone guilty
12. definition=receive a specified treatment (abstract) | examples=These aspects of civilization do not find expression or receive an interpretation
13. definition=perceive oneself to be in a certain condition or place | examples=I found myself in a difficult situation
14. definition=get or find back; recover the use of | examples=She regained control of herself
15. definition=succeed in reaching; arrive at | examples=The arrow found its mark
16. definition=accept and make use of one's personality, abilities, and situation | examples=My son went to Berkeley to find himself

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    come upon, as if by accident; meet with

    find%2:40:02:: · find.v.01

    • We find this idea in Plato
    • I happened upon the most wonderful bakery not very far from here

    Synonyms: happen, chance, bump, encounter

    Selected
  2. 2

    discover or determine the existence, presence, or fact of

    find%2:39:02:: · detect.v.01

    • She detected high levels of lead in her drinking water
    • We found traces of lead in the paint

    Synonyms: detect, observe, discover, notice

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    come upon after searching; find the location of something that was missed or lost

    find%2:40:00:: · find.v.03

    • Did you find your glasses?
    • I cannot find my gloves!

    Synonyms: regain

  4. 4

    establish after a calculation, investigation, experiment, survey, or study

    find%2:32:00:: · determine.v.01

    • find the product of two numbers
    • The physicist who found the elusive particle won the Nobel Prize

    Synonyms: determine, find out, ascertain

  5. 5

    come to believe on the basis of emotion, intuitions, or indefinite grounds

    find%2:31:10:: · find.v.05

    • I feel that he doesn't like me
    • I find him to be obnoxious

    Synonyms: feel

  6. 6

    perceive or be contemporaneous with

    find%2:39:01:: · witness.v.02

    • We found Republicans winning the offices
    • You'll see a lot of cheating in this school

    Synonyms: witness, see

  7. 7

    get something or somebody for a specific purpose

    find%2:40:01:: · line_up.v.02

    • I found this gadget that will serve as a bottle opener
    • I got hold of these tools to fix our plumbing

    Synonyms: line up, get hold, come up

  8. 8

    make a discovery, make a new finding

    find%2:36:00:: · discover.v.03

    • Roentgen discovered X-rays
    • Physicists believe they found a new elementary particle

    Synonyms: discover

  9. 9

    make a discovery

    find%2:31:09:: · discover.v.04

    • She found that he had lied to her
    • The story is false, so far as I can discover

    Synonyms: discover

  10. 10

    obtain through effort or management

    find%2:40:03:: · find.v.10

    • She found the time and energy to take care of her aging parents
    • We found the money to send our sons to college
  11. 11

    decide on and make a declaration about

    find%2:32:01:: · rule.v.04

    • find someone guilty

    Synonyms: rule

  12. 12

    receive a specified treatment (abstract)

    find%2:30:00:: · receive.v.02

    • These aspects of civilization do not find expression or receive an interpretation
    • His movie received a good review

    Synonyms: receive, get, obtain, incur

  13. 13

    perceive oneself to be in a certain condition or place

    find%2:39:05:: · find.v.13

    • I found myself in a difficult situation
    • When he woke up, he found himself in a hospital room
  14. 14

    get or find back; recover the use of

    find%2:40:15:: · recover.v.01

    • She regained control of herself
    • She found her voice and replied quickly

    Synonyms: recover, retrieve, regain

  15. 15

    succeed in reaching; arrive at

    find%2:38:10:: · find.v.15

    • The arrow found its mark
  16. 16

    accept and make use of one's personality, abilities, and situation

    find%2:30:13:: · find_oneself.v.01

    • My son went to Berkeley to find himself

    Synonyms: find oneself

introduce Verb

Instance: semeval2015.d001.s023.t000 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

If we introduce the condition before the? it will use this condition only if it is true, if it finds a? without any condition, it will enter in the last instance.

Show raw prompt

user

Which numbered sense of "introduce" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: If we <t>introduce</t> the condition before the? it will use this condition only if it is true, if it finds a? without any condition, it will enter in the last instance.

Senses:
1. definition=cause to come to know personally | examples=permit me to acquaint you with my son
2. definition=bring something new to an environment | examples=A new word processor was introduced
3. definition=introduce | examples=Insert your ticket here
4. definition=bring in a new person or object into a familiar environment | examples=He brought in a new judge
5. definition=bring in or establish in a new place or environment | examples=introduce a rule
6. definition=put or introduce into something | examples=insert a picture into the text
7. definition=bring before the public for the first time, as of an actor, song, etc.
8. definition=put before (a body) | examples=introduce legislation
9. definition=furnish with a preface or introduction | examples=She always precedes her lectures with a joke
10. definition=be a precursor of | examples=The fall of the Berlin Wall ushered in the post-Cold War period

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    cause to come to know personally

    introduce%2:32:00:: · introduce.v.01

    • permit me to acquaint you with my son
    • introduce the new neighbors to the community

    Synonyms: present, acquaint

  2. 2

    bring something new to an environment

    introduce%2:36:00:: · introduce.v.02

    • A new word processor was introduced

    Synonyms: innovate

  3. 3

    introduce

    introduce%2:30:03:: · insert.v.02

    • Insert your ticket here

    Synonyms: insert, enclose, inclose, stick in, put in

    Gold lexEN Gold Maru 2022
  4. 4

    bring in a new person or object into a familiar environment

    introduce%2:38:00:: · bring_in.v.01

    • He brought in a new judge
    • The new secretary introduced a nasty rumor

    Synonyms: bring in

  5. 5

    bring in or establish in a new place or environment

    introduce%2:36:01:: · introduce.v.05

    • introduce a rule
    • introduce exotic fruits
    Selected
  6. 6

    put or introduce into something

    introduce%2:35:00:: · insert.v.01

    • insert a picture into the text

    Synonyms: insert, infix, enter

    Gold lexEN Gold Maru 2022 Gold Raganato
  7. 7

    bring before the public for the first time, as of an actor, song, etc.

    introduce%2:32:02:: · introduce.v.07

    Synonyms: bring out

  8. 8

    put before (a body)

    introduce%2:31:00:: · introduce.v.08

    • introduce legislation
  9. 9

    furnish with a preface or introduction

    introduce%2:32:01:: · precede.v.05

    • She always precedes her lectures with a joke
    • He prefaced his lecture with a critical remark about the institution

    Synonyms: precede, preface, premise

  10. 10

    be a precursor of

    introduce%2:30:00:: · inaugurate.v.03

    • The fall of the Berlin Wall ushered in the post-Cold War period

    Synonyms: inaugurate, usher in

define Verb

Instance: semeval2015.d001.s025.t001 Dataset: semeval2015 Bucket: POS / VERB

Incorrect

It can be used to define a container.

Show raw prompt

user

Which numbered sense of "define" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: It can be used to <t>define</t> a container.

Senses:
1. definition=determine the essential quality of
2. definition=give a definition for the meaning of a word | examples=Define `sadness'
3. definition=determine the nature of | examples=What defines a good wine?
4. definition=show the form or outline of | examples=The tree was clearly defined by the light
5. definition=decide upon or fix definitely | examples=fix the variables

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    determine the essential quality of

    define%2:42:00:: · specify.v.03

    Synonyms: specify, delineate, delimit, delimitate

    Selected
  2. 2

    give a definition for the meaning of a word

    define%2:32:00:: · define.v.02

    • Define `sadness'
  3. 3

    determine the nature of

    define%2:42:01:: · define.v.03

    • What defines a good wine?
    Gold Raganato
  4. 4

    show the form or outline of

    define%2:42:03:: · define.v.04

    • The tree was clearly defined by the light
    • The camera could define the smallest object

    Synonyms: delineate

  5. 5

    decide upon or fix definitely

    define%2:32:01:: · specify.v.02

    • fix the variables
    • specify the parameters

    Synonyms: specify, set, determine, fix, limit

    Gold lexEN Gold Maru 2022 Gold Raganato