Verified run

nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B

vllm-nemotron-3-nano-30b-fp8-h100-p002-lexen-v1-20260614

Rank
170
Accuracy lexEN v1 · WordNet fine
69.22%
Correct
3365 / 4861
Actual run cost
$0.0143
Cost / M items
$2.94

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 69.22% 3365 / 4861 83.95% 4081 / 4861 79.65% 3872 / 4861
Maru 2022 (ALLamended) 67.99% 3305 / 4861 83.56% 4062 / 4861 79.08% 3844 / 4861
Raganato 2017 (original) 63.24% 3074 / 4861 81.67% 3970 / 4861 75.81% 3685 / 4861

Model

Display
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B
Requested
hosted_vllm/nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B
Resolved
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B
Vendor
NVIDIA
API provider
n/a
Hosting
self_hosted
Source
open_source
License
nvidia-open
Reasoning
n/a
Model URL
https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B
Endpoint
http://localhost:8000/v1
Resolved counts
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B: 4861
HF revision
f8dc1c0afee92f44417695b4f5ddca9afc95ea58
Quantization
fp8
Inference engine
vllm
Engine version
0.22.1
Container image
vllm/vllm-openai:v0.22.1
Serve command
exec vllm serve nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 --port 8000 --served-model-name nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B --max-model-len 8192 --gpu-memory-utilization 0.90 --trust-remote-code --max-num-seqs 128 --default-chat-template-kwargs \{\"enable_thinking\":\ false\} --revision f8dc1c0afee92f44417695b4f5ddca9afc95ea58

Reproducibility

Created
2026-06-14T17:08:45.708843+00:00
Run schema
sensebench-run-v2
Commit
n/a
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p002
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
1,204,802
Tokens / item
247.9
Total cost
$0.0143
Cost / M items
$2.94
Cost source
machine_time_estimate
Elapsed
22.39s
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Machine & Timing

GPU
NVIDIA H100 80GB HBM3
VRAM / GPU
81,559 MiB
Driver
595.71.05
CUDA
13.2
CPU
AMD EPYC 7R13 Processor (192 cores)
RAM
1,999.9 GiB
Platform
Linux-6.17.0-1017-aws-x86_64-with-glibc2.35
Provider
vast.ai (40919268)
Hourly rate
$2.30/h
Benchmark time
22.39s
Machine-hours / 1M items
1.28 h/M
Concurrency
128

Benchmark time covers only the per-item evaluation loop on this machine, excluding model and asset loading.

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
0.0000
Top P
n/a
Max tokens
128
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.0143. Cost estimate source: machine_time_estimate. Cost is estimated from machine time multiplied by the recorded hourly rate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 1,194,920 n/a n/a
Input cached n/a n/a n/a
Output 9,882 n/a n/a
Reasoning output n/a included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 60.08% 477 794
Candidate Count 2 81.64% 698 855
Candidate Count 3-5 70.03% 1362 1945
Candidate Count 6-10 65.35% 828 1267
POS ADJ 75.11% 495 659
POS ADV 52.82% 103 195
POS NOUN 73.35% 2125 2897
POS VERB 57.84% 642 1110
Source Dataset semeval2013 76.40% 871 1140
Source Dataset semeval2015 69.82% 516 739
Source Dataset senseval2 66.11% 1077 1629
Source Dataset senseval3 66.59% 901 1353

Worst-Bucket Examples

easily Adv

Instance: semeval2015.d000.s009.t012 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread easily, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not affecting the squamous cells.

Show raw prompt

user

Which numbered sense of "easily" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread <t>easily</t>, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not affecting the squamous cells.

Senses:
1. definition=with ease (`easy' is sometimes used informally for `easily') | examples=she was easily excited
2. definition=without question | examples=easily the best book she's written
3. definition=indicating high probability; in all likelihood | examples=I might well do it

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    with ease (`easy' is sometimes used informally for `easily')

    easily%4:02:01:: · easily.r.01

    • she was easily excited
    • was easily confused

    Synonyms: easy

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    without question

    easily%4:02:06:: · easily.r.02

    • easily the best book she's written
    Selected
  3. 3

    indicating high probability; in all likelihood

    easily%4:02:05:: · well.r.03

    • I might well do it
    • a mistake that could easily have ended in disaster

    Synonyms: well

only Adv

Instance: semeval2015.d000.s013.t000 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy.

Show raw prompt

user

Which numbered sense of "only" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Alimta should <t>only</t> be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy.

Senses:
1. definition=and nothing more | examples=I was merely asking
2. definition=without any others being included or involved | examples=was entirely to blame
3. definition=with nevertheless the final result | examples=He arrived only to find his wife dead
4. definition=in the final outcome | examples=These news will only make you more upset
5. definition=except that | examples=It was the same story; only this time she came out better
6. definition=never except when | examples=call me only if your cold gets worse
7. definition=as recently as | examples=I spoke to him only an hour ago

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    and nothing more

    only%4:02:02:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, just, but

  2. 2

    without any others being included or involved

    only%4:02:01:: · entirely.r.02

    • was entirely to blame
    • a school devoted entirely to the needs of problem children

    Synonyms: entirely, exclusively, solely, alone

    Selected
  3. 3

    with nevertheless the final result

    only%4:02:00:: · only.r.03

    • He arrived only to find his wife dead
    • We won only to lose again in the next round
  4. 4

    in the final outcome

    only%4:02:04:: · only.r.04

    • These news will only make you more upset
  5. 5

    except that

    only%4:02:06:: · only.r.05

    • It was the same story; only this time she came out better
  6. 6

    never except when

    only%4:02:03:: · only.r.06

    • call me only if your cold gets worse

    Synonyms: only if, only when

    Gold lexEN Gold Maru 2022 Gold Raganato
  7. 7

    as recently as

    only%4:02:05:: · only.r.07

    • I spoke to him only an hour ago

once Adv

Instance: semeval2015.d000.s015.t001 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

It is given once every three weeks as an intravenous infusion lasting 10 minutes.

Show raw prompt

user

Which numbered sense of "once" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: It is given <t>once</t> every three weeks as an intravenous infusion lasting 10 minutes.

Senses:
1. definition=on one occasion | examples=once I ran into her
2. definition=as soon as | examples=once we are home, we can rest
3. definition=at a previous time | examples=at one time he loved her

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    on one occasion

    once%4:02:00:: · once.r.01

    • once I ran into her

    Synonyms: one time, in one case

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    as soon as

    once%4:02:02:: · once.r.02

    • once we are home, we can rest
    Selected
  3. 3

    at a previous time

    once%4:02:01:: · once.r.03

    • at one time he loved her
    • her erstwhile writing

    Synonyms: formerly, at one time, erstwhile, erst

below Adv

Instance: semeval2015.d001.s008.t000 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

Below these tabs you will find an input field to type your functions or do your calculations.

Show raw prompt

user

Which numbered sense of "below" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: <t>Below</t> these tabs you will find an input field to type your functions or do your calculations.

Senses:
1. definition=in or to a place that is lower
2. definition=at a later place | examples=see below
3. definition=(in writing) see below | examples=vide infra
4. definition=on a floor below | examples=the tenants live downstairs
5. definition=further down | examples=see under for further discussion

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    in or to a place that is lower

    below%4:02:01:: · below.r.01

    Synonyms: at a lower place, to a lower place, beneath

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    at a later place

    below%4:02:00:: · below.r.02

    • see below
    Selected
  3. 3

    (in writing) see below

    below%4:02:02:: · below.r.03

    • vide infra

    Synonyms: infra

  4. 4

    on a floor below

    below%4:02:06:: · downstairs.r.01

    • the tenants live downstairs

    Synonyms: downstairs, down the stairs, on a lower floor

  5. 5

    further down

    below%4:02:03:: · under.r.08

    • see under for further discussion

    Synonyms: under

very Adv

Instance: semeval2015.d001.s011.t003 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

I ve looked closely to maxima and maple s syntax so they look very similar.

Show raw prompt

user

Which numbered sense of "very" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: I ve looked closely to maxima and maple s syntax so they look <t>very</t> similar.

Senses:
1. definition=used as intensifiers; `real' is sometimes used informally for `really'; `rattling' is informal | examples=she was very gifted
2. definition=precisely so | examples=on the very next page

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    used as intensifiers; `real' is sometimes used informally for `really'; `rattling' is informal

    very%4:02:00:: · very.r.01

    • she was very gifted
    • he played very well

    Synonyms: really, real, rattling

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    precisely so

    very%4:02:01:: · very.r.02

    • on the very next page
    • he expected the very opposite
    Selected

too Adv

Instance: semeval2015.d001.s015.t004 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

Powers are one way to make roots too.

Show raw prompt

user

Which numbered sense of "too" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Powers are one way to make roots <t>too</t>.

Senses:
1. definition=to a degree exceeding normal or proper limits | examples=too big
2. definition=in addition | examples=he has a Mercedes, too

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    to a degree exceeding normal or proper limits

    too%4:02:00:: · excessively.r.01

    • too big

    Synonyms: excessively, overly, to a fault

    Selected
  2. 2

    in addition

    too%4:02:01:: · besides.r.02

    • he has a Mercedes, too

    Synonyms: besides, also, likewise, as well

    Gold lexEN Gold Maru 2022 Gold Raganato

now Adv

Instance: semeval2015.d001.s027.t000 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

Now you could ask me, why should the user mind about MathML?

Show raw prompt

user

Which numbered sense of "now" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: <t>Now</t> you could ask me, why should the user mind about MathML?

Senses:
1. definition=in the historical present; at this point in the narration of a series of past events | examples=President Kennedy now calls in the National Guard
2. definition=in these times; - Nancy Mitford | examples=it is solely by their language that the upper classes nowadays are distinguished
3. definition=used to preface a command or reproof or request | examples=now hear this!
4. definition=at the present moment | examples=goods now on sale
5. definition=without delay or hesitation; with no time intervening | examples=he answered immediately
6. definition=(prefatory or transitional) indicates a change of subject or activity | examples=Now the next problem is...
7. definition=in the immediate past | examples=told me just now

Prediction matches gold: lexEN ✗ Maru 2022 ✓ Raganato ✓

WordNet 3.0 senses

  1. 1

    in the historical present; at this point in the narration of a series of past events

    now%4:02:05:: · now.r.01

    • President Kennedy now calls in the National Guard
    • Washington now decides to cross the Delaware
  2. 2

    in these times; - Nancy Mitford

    now%4:02:00:: · nowadays.r.01

    • it is solely by their language that the upper classes nowadays are distinguished
    • we now rarely see horse-drawn vehicles on city streets

    Synonyms: nowadays, today

  3. 3

    used to preface a command or reproof or request

    now%4:02:02:: · now.r.03

    • now hear this!
    • now pay attention
    Gold Raganato
  4. 4

    at the present moment

    now%4:02:04:: · now.r.04

    • goods now on sale
    • the now-aging dictator

    Synonyms: at present

    Gold Maru 2022 Gold Raganato Selected
  5. 5

    without delay or hesitation; with no time intervening

    now%4:02:01:: · immediately.r.01

    • he answered immediately
    • found an answer straightaway

    Synonyms: immediately, instantly, straightaway, straight off, directly, right away, at once, forthwith, like a shot

  6. 6

    (prefatory or transitional) indicates a change of subject or activity

    now%4:02:07:: · now.r.06

    • Now the next problem is...
    Gold lexEN
  7. 7

    in the immediate past

    now%4:02:06:: · now.r.07

    • told me just now

just Adv

Instance: semeval2015.d001.s033.t004 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

By double clicking on them you will see a dialog that lets you change their values (just a way to trick the log).

Show raw prompt

user

Which numbered sense of "just" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: By double clicking on them you will see a dialog that lets you change their values (<t>just</t> a way to trick the log).

Senses:
1. definition=and nothing more | examples=I was merely asking
2. definition=indicating exactness or preciseness | examples=he was doing precisely (or exactly) what she had told him to do
3. definition=only a moment ago | examples=he has just arrived
4. definition=absolutely | examples=I just can't take it anymore
5. definition=only a very short time before; ; ; ; ; - W.B.Yeats | examples=they could barely hear the speaker
6. definition=exactly at this moment or the moment described | examples=we've just finished painting the walls, so don't touch them

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    and nothing more

    just%4:02:00:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, only, but

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    indicating exactness or preciseness

    just%4:02:05:: · precisely.r.01

    • he was doing precisely (or exactly) what she had told him to do
    • it was just as he said--the jewel was gone

    Synonyms: precisely, exactly

    Selected
  3. 3

    only a moment ago

    just%4:02:01:: · just.r.03

    • he has just arrived
    • the sun just now came out

    Synonyms: just now

  4. 4

    absolutely

    just%4:02:03:: · just.r.04

    • I just can't take it anymore
    • he was just grand as Romeo

    Synonyms: simply

  5. 5

    only a very short time before; ; ; ; ; - W.B.Yeats

    just%4:02:04:: · barely.r.01

    • they could barely hear the speaker
    • we hardly knew them

    Synonyms: barely, hardly, scarcely, scarce

  6. 6

    exactly at this moment or the moment described

    just%4:02:06:: · just.r.06

    • we've just finished painting the walls, so don't touch them

just Adv

Instance: semeval2015.d001.s052.t000 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

Just use the Add button when you are in List mode.

Show raw prompt

user

Which numbered sense of "just" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: <t>Just</t> use the Add button when you are in List mode.

Senses:
1. definition=and nothing more | examples=I was merely asking
2. definition=indicating exactness or preciseness | examples=he was doing precisely (or exactly) what she had told him to do
3. definition=only a moment ago | examples=he has just arrived
4. definition=absolutely | examples=I just can't take it anymore
5. definition=only a very short time before; ; ; ; ; - W.B.Yeats | examples=they could barely hear the speaker
6. definition=exactly at this moment or the moment described | examples=we've just finished painting the walls, so don't touch them

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    and nothing more

    just%4:02:00:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, only, but

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    indicating exactness or preciseness

    just%4:02:05:: · precisely.r.01

    • he was doing precisely (or exactly) what she had told him to do
    • it was just as he said--the jewel was gone

    Synonyms: precisely, exactly

    Selected
  3. 3

    only a moment ago

    just%4:02:01:: · just.r.03

    • he has just arrived
    • the sun just now came out

    Synonyms: just now

  4. 4

    absolutely

    just%4:02:03:: · just.r.04

    • I just can't take it anymore
    • he was just grand as Romeo

    Synonyms: simply

  5. 5

    only a very short time before; ; ; ; ; - W.B.Yeats

    just%4:02:04:: · barely.r.01

    • they could barely hear the speaker
    • we hardly knew them

    Synonyms: barely, hardly, scarcely, scarce

  6. 6

    exactly at this moment or the moment described

    just%4:02:06:: · just.r.06

    • we've just finished painting the walls, so don't touch them

more Adv

Instance: semeval2015.d002.s002.t013 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

There were relatively few cases reported of attempts to involve users in service planning but their involvement in service provision was found to be more common.

Show raw prompt

user

Which numbered sense of "more" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: There were relatively few cases reported of attempts to involve users in service planning but their involvement in service provision was found to be <t>more</t> common.

Senses:
1. definition=used to form the comparative of some adjectives and adverbs | examples=more interesting
2. definition=comparative of much; to a greater degree or extent | examples=he works more now

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    used to form the comparative of some adjectives and adverbs

    more%4:02:00:: · more.r.01

    • more interesting
    • more beautiful

    Synonyms: to a greater extent

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    comparative of much; to a greater degree or extent

    more%4:02:01:: · more.r.02

    • he works more now
    • they eat more than they should
    Selected

so Adv

Instance: semeval2015.d003.s004.t005 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

The tablets are pale-orange and have a score line on both sides so that they can be halved.

Show raw prompt

user

Which numbered sense of "so" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The tablets are pale-orange and have a score line on both sides <t>so</t> that they can be halved.

Senses:
1. definition=to a very great extent or degree | examples=the idea is so obvious
2. definition=in a manner that facilitates | examples=he observed the snakes so he could describe their behavior
3. definition=in such a condition or manner, especially as expressed or implied | examples=They're happy and I hope they will remain so
4. definition=to a certain unspecified extent or degree | examples=I can only go so far with this student
5. definition=in the same way; also | examples=I was offended and so was he
6. definition=in the way indicated; ; ; (`thusly' is a nonstandard variant) | examples=hold the brush so
7. definition=(usually followed by `that') to an extent or degree as expressed | examples=he was so tired he could hardly stand
8. definition=subsequently or soon afterward (often used as sentence connectors) | examples=then he left
9. definition=(used to introduce a logical conclusion) from that fact or reason or as a result | examples=therefore X must be true
10. definition=in truth (often tends to intensify) | examples=they said the car would break down and indeed it did

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    to a very great extent or degree

    so%4:02:02:: · so.r.01

    • the idea is so obvious
    • never been so happy
  2. 2

    in a manner that facilitates

    so%4:02:06:: · so.r.02

    • he observed the snakes so he could describe their behavior
    • he stooped down so he could pick up his hat
    Gold lexEN Gold Maru 2022
  3. 3

    in such a condition or manner, especially as expressed or implied

    so%4:02:05:: · so.r.03

    • They're happy and I hope they will remain so
    • so live your life that old age will bring no regrets
  4. 4

    to a certain unspecified extent or degree

    so%4:02:07:: · so.r.04

    • I can only go so far with this student
    • can do only so much in a day
  5. 5

    in the same way; also

    so%4:02:08:: · so.r.05

    • I was offended and so was he
    • worked hard and so did she
  6. 6

    in the way indicated; ; ; (`thusly' is a nonstandard variant)

    so%4:02:04:: · thus.r.02

    • hold the brush so
    • set up the pieces thus

    Synonyms: thus, thusly

  7. 7

    (usually followed by `that') to an extent or degree as expressed

    so%4:02:03:: · so.r.07

    • he was so tired he could hardly stand
    • so dirty that it smells
    Gold Raganato
  8. 8

    subsequently or soon afterward (often used as sentence connectors)

    so%4:02:09:: · then.r.01

    • then he left
    • go left first, then right

    Synonyms: then, and so, and then

  9. 9

    (used to introduce a logical conclusion) from that fact or reason or as a result

    so%4:02:10:: · therefore.r.01

    • therefore X must be true
    • the eggs were fresh and hence satisfactory

    Synonyms: therefore, hence, thence, thus

    Selected
  10. 10

    in truth (often tends to intensify)

    so%4:02:00:: · indeed.r.01

    • they said the car would break down and indeed it did
    • it is very cold indeed

    Synonyms: indeed

well Adv

Instance: semeval2015.d003.s021.t001 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

Cerenia was generally well tolerated when administered daily at dosages up to 5 times the recommended doses for an extended period of time (up to 3 times the recommended maximum duration of treatment).

Show raw prompt

user

Which numbered sense of "well" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: Cerenia was generally <t>well</t> tolerated when administered daily at dosages up to 5 times the recommended doses for an extended period of time (up to 3 times the recommended maximum duration of treatment).

Senses:
1. definition=(often used as a combining form) in a good or proper or satisfactory manner or to a high standard (`good' is a nonstandard dialectal variant for `well') | examples=the children behaved well
2. definition=thoroughly or completely; fully; often used as a combining form; ; ; ; ; , | examples=The problem is well understood
3. definition=indicating high probability; in all likelihood | examples=I might well do it
4. definition=(used for emphasis or as an intensifier) entirely or fully | examples=a book well worth reading
5. definition=to a suitable or appropriate extent or degree | examples=the project was well underway
6. definition=favorably; with approval | examples=their neighbors spoke well of them
7. definition=to a great extent or degree | examples=I'm afraid the film was well over budget
8. definition=with great or especially intimate knowledge | examples=we knew them well
9. definition=with prudence or propriety | examples=You would do well to say nothing more
10. definition=with skill or in a pleasing manner | examples=she dances well
11. definition=in a manner affording benefit or advantage | examples=she married well
12. definition=in financial comfort | examples=They live well
13. definition=without unusual distress or resentment; with good humor | examples=took the joke well

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    (often used as a combining form) in a good or proper or satisfactory manner or to a high standard (`good' is a nonstandard dialectal variant for `well')

    well%4:02:00:: · well.r.01

    • the children behaved well
    • a task well done

    Synonyms: good

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    thoroughly or completely; fully; often used as a combining form; ; ; ; ; ,

    well%4:02:05:: · well.r.02

    • The problem is well understood
    • she was well informed
  3. 3

    indicating high probability; in all likelihood

    well%4:02:03:: · well.r.03

    • I might well do it
    • a mistake that could easily have ended in disaster

    Synonyms: easily

  4. 4

    (used for emphasis or as an intensifier) entirely or fully

    well%4:02:15:: · well.r.04

    • a book well worth reading
    • was well aware of the difficulties ahead
  5. 5

    to a suitable or appropriate extent or degree

    well%4:02:08:: · well.r.05

    • the project was well underway
    • the fetus has well developed organs
    Selected
  6. 6

    favorably; with approval

    well%4:02:07:: · well.r.06

    • their neighbors spoke well of them
    • he thought well of the book
  7. 7

    to a great extent or degree

    well%4:02:11:: · well.r.07

    • I'm afraid the film was well over budget
    • painting the room white made it seem considerably (or substantially) larger

    Synonyms: considerably, substantially

  8. 8

    with great or especially intimate knowledge

    well%4:02:14:: · well.r.08

    • we knew them well

    Synonyms: intimately

  9. 9

    with prudence or propriety

    well%4:02:13:: · well.r.09

    • You would do well to say nothing more
    • could not well refuse
  10. 10

    with skill or in a pleasing manner

    well%4:02:12:: · well.r.10

    • she dances well
    • he writes well
  11. 11

    in a manner affording benefit or advantage

    well%4:02:10:: · well.r.11

    • she married well
    • The children were settled advantageously in Seattle

    Synonyms: advantageously

  12. 12

    in financial comfort

    well%4:02:09:: · well.r.12

    • They live well
    • she has been able to live comfortably since her husband died

    Synonyms: comfortably

  13. 13

    without unusual distress or resentment; with good humor

    well%4:02:01:: · well.r.13

    • took the joke well
    • took the tragic news well