Verified run

gpt-5.5

gpt-5.5-none-reasoning-p003-lexen-v1-20260617

Rank
33
Accuracy lexEN v1 · WordNet fine
92.88%
Correct
4515 / 4861
Actual run cost
$10.98
Cost / M items
$2,260

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 92.88% 4515 / 4861 97.72% 4750 / 4861 95.64% 4649 / 4861
Maru 2022 (ALLamended) 89.71% 4361 / 4861 96.56% 4694 / 4861 93.68% 4554 / 4861
Raganato 2017 (original) 83.75% 4071 / 4861 93.87% 4563 / 4861 89.84% 4367 / 4861

Model

Display
gpt-5.5
Requested
gpt-5.5
Resolved
gpt-5.5-2026-04-23
Vendor
OpenAI
API provider
OpenAI
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
none
Model URL
n/a
Endpoint
n/a
Resolved counts
gpt-5.5-2026-04-23: 4861

Reproducibility

Created
2026-06-17T11:29:06.305785+00:00
Run schema
sensebench-run-v2
Commit
0dc5efa96637288a1e61ef0a75c06425d8fa9108
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p003
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
2,099,475
Tokens / item
431.9
Total cost
$10.98
Cost / M items
$2,260
Cost source
litellm_estimate
Elapsed
1.55m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
8,192
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $10.98. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 2,080,031 $10.40 $5.00
Input cached 0 $0.00 $0.500
Output 19,444 $0.583 $30.00
Reasoning output 0 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 90.81% 721 794
Candidate Count 2 95.67% 818 855
Candidate Count 3-5 93.11% 1811 1945
Candidate Count 6-10 91.95% 1165 1267
POS ADJ 93.17% 614 659
POS ADV 87.69% 171 195
POS NOUN 94.17% 2728 2897
POS VERB 90.27% 1002 1110
Source Dataset semeval2013 94.74% 1080 1140
Source Dataset semeval2015 92.69% 685 739
Source Dataset senseval2 92.69% 1510 1629
Source Dataset senseval3 91.65% 1240 1353

Worst-Bucket Examples

easily Adv

Instance: semeval2015.d000.s009.t012 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

What is Alimta?

Alimta is a powder that is made up into a solution for infusion (drip into a vein).

It contains the active substance pemetrexed.

What is Alimta used for?

Alimta is used to treat two types of cancer: pleural mesothelioma (cancer of the lining of the lungs that is usually caused by exposure to asbestos).

Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread easily, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not affecting the squamous cells.

Alimta is used in combination with cisplatin in patients who have not been treated before, and on its own in patients who have received another type of chemotherapy in the past.

Show raw prompt

user

Which numbered sense of "easily" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: What is Alimta? Alimta is a powder that is made up into a solution for infusion (drip into a vein). It contains the active substance pemetrexed. What is Alimta used for? Alimta is used to treat two types of cancer: pleural mesothelioma (cancer of the lining of the lungs that is usually caused by exposure to asbestos). Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread <t>easily</t>, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not affecting the squamous cells. Alimta is used in combination with cisplatin in patients who have not been treated before, and on its own in patients who have received another type of chemotherapy in the past.

Senses:
1. definition=with ease (`easy' is sometimes used informally for `easily') | synonyms=easy | examples=she was easily excited; was easily confused
2. definition=without question | examples=easily the best book she's written
3. definition=indicating high probability; in all likelihood | synonyms=well | examples=I might well do it; a mistake that could easily have ended in disaster

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    with ease (`easy' is sometimes used informally for `easily')

    easily%4:02:01:: · easily.r.01

    • she was easily excited
    • was easily confused

    Synonyms: easy

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    without question

    easily%4:02:06:: · easily.r.02

    • easily the best book she's written
  3. 3

    indicating high probability; in all likelihood

    easily%4:02:05:: · well.r.03

    • I might well do it
    • a mistake that could easily have ended in disaster

    Synonyms: well

    Selected

only Adv

Instance: semeval2015.d000.s013.t000 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

Alimta is used to treat two types of cancer: pleural mesothelioma (cancer of the lining of the lungs that is usually caused by exposure to asbestos).

Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread easily, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not affecting the squamous cells.

Alimta is used in combination with cisplatin in patients who have not been treated before, and on its own in patients who have received another type of chemotherapy in the past.

The medicine can only be obtained with a prescription.

How is Alimta used?

Alimta should only be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy.

The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight).

Show raw prompt

user

Which numbered sense of "only" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Alimta is used to treat two types of cancer: pleural mesothelioma (cancer of the lining of the lungs that is usually caused by exposure to asbestos). Alimta is used together with cisplatin (another anticancer medicine) when the cancer is unresectable (cannot be removed by surgery alone) and malignant (has spread, or is likely to spread easily, to other parts of the body), in patients who have not received chemotherapy (medicines for cancer) before advanced or metastatic non-small cell lung cancer that is not affecting the squamous cells. Alimta is used in combination with cisplatin in patients who have not been treated before, and on its own in patients who have received another type of chemotherapy in the past. The medicine can only be obtained with a prescription. How is Alimta used? Alimta should <t>only</t> be given under the supervision of a doctor who is qualified in the use of anticancer chemotherapy. The recommended dose of Alimta is 500 mg per square metre of body surface area (calculated using the patient s height and weight).

Senses:
1. definition=and nothing more | synonyms=merely, simply, just, but | examples=I was merely asking; it is simply a matter of time
2. definition=without any others being included or involved | synonyms=entirely, exclusively, solely, alone | examples=was entirely to blame; a school devoted entirely to the needs of problem children
3. definition=with nevertheless the final result | examples=He arrived only to find his wife dead; We won only to lose again in the next round
4. definition=in the final outcome | examples=These news will only make you more upset
5. definition=except that | examples=It was the same story; only this time she came out better
6. definition=never except when | synonyms=only if, only when | examples=call me only if your cold gets worse
7. definition=as recently as | examples=I spoke to him only an hour ago

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    and nothing more

    only%4:02:02:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, just, but

  2. 2

    without any others being included or involved

    only%4:02:01:: · entirely.r.02

    • was entirely to blame
    • a school devoted entirely to the needs of problem children

    Synonyms: entirely, exclusively, solely, alone

    Selected
  3. 3

    with nevertheless the final result

    only%4:02:00:: · only.r.03

    • He arrived only to find his wife dead
    • We won only to lose again in the next round
  4. 4

    in the final outcome

    only%4:02:04:: · only.r.04

    • These news will only make you more upset
  5. 5

    except that

    only%4:02:06:: · only.r.05

    • It was the same story; only this time she came out better
  6. 6

    never except when

    only%4:02:03:: · only.r.06

    • call me only if your cold gets worse

    Synonyms: only if, only when

    Gold lexEN Gold Maru 2022 Gold Raganato
  7. 7

    as recently as

    only%4:02:05:: · only.r.07

    • I spoke to him only an hour ago

actually Adv

Instance: semeval2015.d001.s002.t000 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

kalgebra is a mathematical calculator based on content markup MathML language.

Nowadays it is capable to make simple MathML operations (arithmetic and logical) and to representate 2D and 3D graphs.

It is actually not necessary to know MathML to use kalgebra.

kalgebra is a MathML based graph calculator.

Show raw prompt

user

Which numbered sense of "actually" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: kalgebra is a mathematical calculator based on content markup MathML language. Nowadays it is capable to make simple MathML operations (arithmetic and logical) and to representate 2D and 3D graphs. It is <t>actually</t> not necessary to know MathML to use kalgebra. kalgebra is a MathML based graph calculator.

Senses:
1. definition=in actual fact | synonyms=really | examples=to be nominally but not actually independent; no one actually saw the shark
2. definition=used to imply that one would expect the fact to be the opposite of that stated; surprisingly | synonyms=in reality | examples=you may actually be doing the right thing by walking out; she actually spoke Latin
3. definition=at the present moment | examples=the transmission screen shows the picture that is actually on the air
4. definition=as a sentence modifier to add slight emphasis | examples=actually, we all help clear up after a meal; actually, I haven't seen the film

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    in actual fact

    actually%4:02:01:: · actually.r.01

    • to be nominally but not actually independent
    • no one actually saw the shark

    Synonyms: really

    Selected
  2. 2

    used to imply that one would expect the fact to be the opposite of that stated; surprisingly

    actually%4:02:00:: · actually.r.02

    • you may actually be doing the right thing by walking out
    • she actually spoke Latin

    Synonyms: in reality

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    at the present moment

    actually%4:02:03:: · actually.r.03

    • the transmission screen shows the picture that is actually on the air
  4. 4

    as a sentence modifier to add slight emphasis

    actually%4:02:02:: · actually.r.04

    • actually, we all help clear up after a meal
    • actually, I haven't seen the film
    Gold lexEN Gold Maru 2022 Gold Raganato

always Adv

Instance: senseval2.d000.s004.t007 Dataset: senseval2 Bucket: POS / ADV

Incorrect

The art of change-ringing is peculiar to the English, and, like most English peculiarities, unintelligible to the rest of the world.

Dorothy L. Sayers, "The Nine Tailors "

ASLACTON, England --

Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong.

The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have.

In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614.

Show raw prompt

user

Which numbered sense of "always" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: The art of change-ringing is peculiar to the English, and, like most English peculiarities, unintelligible to the rest of the world. Dorothy L. Sayers, "The Nine Tailors "ASLACTON, England -- Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong. The parishioners of St. Michael and All Angels stop to chat at the church door, as members here <t>always</t> have. In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614.

Senses:
1. definition=at all times; all the time and on every occasion | synonyms=ever, e'er | examples=I will always be there to help you; always arrives on time
2. definition=without variation or change, in every case | synonyms=constantly, invariably | examples=constantly kind and gracious; he always arrives on time
3. definition=without interruption | synonyms=constantly, forever, perpetually, incessantly | examples=the world is constantly changing
4. definition=at any time or in any event | examples=you can always resign if you don't like it; you could always take a day off
5. definition=forever; throughout all time | examples=we will always be friends; I shall treasure it always

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    at all times; all the time and on every occasion

    always%4:02:00:: · always.r.01

    • I will always be there to help you
    • always arrives on time

    Synonyms: ever, e'er

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    without variation or change, in every case

    always%4:02:04:: · constantly.r.01

    • constantly kind and gracious
    • he always arrives on time

    Synonyms: constantly, invariably

    Selected
  3. 3

    without interruption

    always%4:02:03:: · constantly.r.02

    • the world is constantly changing

    Synonyms: constantly, forever, perpetually, incessantly

  4. 4

    at any time or in any event

    always%4:02:02:: · always.r.04

    • you can always resign if you don't like it
    • you could always take a day off
  5. 5

    forever; throughout all time

    always%4:02:01:: · always.r.05

    • we will always be friends
    • I shall treasure it always

now Adv

Instance: senseval2.d000.s008.t000 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong.

The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have.

In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614.

But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening.

Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service.

Now, only one local ringer remains: 64-year-old Derek Hammond.

The others here today live elsewhere.

Show raw prompt

user

Which numbered sense of "now" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong. The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have. In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614. But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening. Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service. <t>Now</t>, only one local ringer remains: 64-year-old Derek Hammond. The others here today live elsewhere.

Senses:
1. definition=in the historical present; at this point in the narration of a series of past events | examples=President Kennedy now calls in the National Guard; Washington now decides to cross the Delaware
2. definition=in these times; - Nancy Mitford | synonyms=nowadays, today | examples=it is solely by their language that the upper classes nowadays are distinguished; we now rarely see horse-drawn vehicles on city streets
3. definition=used to preface a command or reproof or request | examples=now hear this!; now pay attention
4. definition=at the present moment | synonyms=at present | examples=goods now on sale; the now-aging dictator
5. definition=without delay or hesitation; with no time intervening | synonyms=immediately, instantly, straightaway, straight off, directly, right away | examples=he answered immediately; found an answer straightaway
6. definition=(prefatory or transitional) indicates a change of subject or activity | examples=Now the next problem is...
7. definition=in the immediate past | examples=told me just now

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    in the historical present; at this point in the narration of a series of past events

    now%4:02:05:: · now.r.01

    • President Kennedy now calls in the National Guard
    • Washington now decides to cross the Delaware
  2. 2

    in these times; - Nancy Mitford

    now%4:02:00:: · nowadays.r.01

    • it is solely by their language that the upper classes nowadays are distinguished
    • we now rarely see horse-drawn vehicles on city streets

    Synonyms: nowadays, today

    Gold Raganato Selected
  3. 3

    used to preface a command or reproof or request

    now%4:02:02:: · now.r.03

    • now hear this!
    • now pay attention
  4. 4

    at the present moment

    now%4:02:04:: · now.r.04

    • goods now on sale
    • the now-aging dictator

    Synonyms: at present

    Gold lexEN Gold Maru 2022
  5. 5

    without delay or hesitation; with no time intervening

    now%4:02:01:: · immediately.r.01

    • he answered immediately
    • found an answer straightaway

    Synonyms: immediately, instantly, straightaway, straight off, directly, right away, at once, forthwith, like a shot

  6. 6

    (prefatory or transitional) indicates a change of subject or activity

    now%4:02:07:: · now.r.06

    • Now the next problem is...
  7. 7

    in the immediate past

    now%4:02:06:: · now.r.07

    • told me just now

only Adv

Instance: senseval2.d000.s008.t001 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong.

The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have.

In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614.

But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening.

Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service.

Now, only one local ringer remains: 64-year-old Derek Hammond.

The others here today live elsewhere.

Show raw prompt

user

Which numbered sense of "only" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong. The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have. In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614. But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening. Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service. Now, <t>only</t> one local ringer remains: 64-year-old Derek Hammond. The others here today live elsewhere.

Senses:
1. definition=and nothing more | synonyms=merely, simply, just, but | examples=I was merely asking; it is simply a matter of time
2. definition=without any others being included or involved | synonyms=entirely, exclusively, solely, alone | examples=was entirely to blame; a school devoted entirely to the needs of problem children
3. definition=with nevertheless the final result | examples=He arrived only to find his wife dead; We won only to lose again in the next round
4. definition=in the final outcome | examples=These news will only make you more upset
5. definition=except that | examples=It was the same story; only this time she came out better
6. definition=never except when | synonyms=only if, only when | examples=call me only if your cold gets worse
7. definition=as recently as | examples=I spoke to him only an hour ago

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    and nothing more

    only%4:02:02:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, just, but

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    without any others being included or involved

    only%4:02:01:: · entirely.r.02

    • was entirely to blame
    • a school devoted entirely to the needs of problem children

    Synonyms: entirely, exclusively, solely, alone

    Selected
  3. 3

    with nevertheless the final result

    only%4:02:00:: · only.r.03

    • He arrived only to find his wife dead
    • We won only to lose again in the next round
  4. 4

    in the final outcome

    only%4:02:04:: · only.r.04

    • These news will only make you more upset
  5. 5

    except that

    only%4:02:06:: · only.r.05

    • It was the same story; only this time she came out better
  6. 6

    never except when

    only%4:02:03:: · only.r.06

    • call me only if your cold gets worse

    Synonyms: only if, only when

  7. 7

    as recently as

    only%4:02:05:: · only.r.07

    • I spoke to him only an hour ago

just Adv

Instance: senseval2.d000.s012.t005 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service.

Now, only one local ringer remains: 64-year-old Derek Hammond.

The others here today live elsewhere.

They belong to a group of 15 ringers -- including two octogenarians and four youngsters in training -- who drive every Sunday from church to church in a sometimes-exhausting effort to keep the bells sounding in the many belfries of East Anglia.

"To ring for even one service at this tower, we have to scrape, "says Mr. Hammond, a retired water-authority worker. "

We've tried to train the youngsters, but they have their discos and their dances, and they just drift away. "

Mr. Hammond worries that old age and the flightiness of youth will diminish the ranks of the East Anglian group that keeps the Aslacton bells pealing.

Show raw prompt

user

Which numbered sense of "just" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service. Now, only one local ringer remains: 64-year-old Derek Hammond. The others here today live elsewhere. They belong to a group of 15 ringers -- including two octogenarians and four youngsters in training -- who drive every Sunday from church to church in a sometimes-exhausting effort to keep the bells sounding in the many belfries of East Anglia. "To ring for even one service at this tower, we have to scrape, "says Mr. Hammond, a retired water-authority worker. "We've tried to train the youngsters, but they have their discos and their dances, and they <t>just</t> drift away. "Mr. Hammond worries that old age and the flightiness of youth will diminish the ranks of the East Anglian group that keeps the Aslacton bells pealing.

Senses:
1. definition=and nothing more | synonyms=merely, simply, only, but | examples=I was merely asking; it is simply a matter of time
2. definition=indicating exactness or preciseness | synonyms=precisely, exactly | examples=he was doing precisely (or exactly) what she had told him to do; it was just as he said--the jewel was gone
3. definition=only a moment ago | synonyms=just now | examples=he has just arrived; the sun just now came out
4. definition=absolutely | synonyms=simply | examples=I just can't take it anymore; he was just grand as Romeo
5. definition=only a very short time before; ; ; ; ; - W.B.Yeats | synonyms=barely, hardly, scarcely, scarce | examples=they could barely hear the speaker; we hardly knew them
6. definition=exactly at this moment or the moment described | examples=we've just finished painting the walls, so don't touch them

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    and nothing more

    just%4:02:00:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, only, but

    Selected
  2. 2

    indicating exactness or preciseness

    just%4:02:05:: · precisely.r.01

    • he was doing precisely (or exactly) what she had told him to do
    • it was just as he said--the jewel was gone

    Synonyms: precisely, exactly

  3. 3

    only a moment ago

    just%4:02:01:: · just.r.03

    • he has just arrived
    • the sun just now came out

    Synonyms: just now

  4. 4

    absolutely

    just%4:02:03:: · just.r.04

    • I just can't take it anymore
    • he was just grand as Romeo

    Synonyms: simply

    Gold lexEN Gold Maru 2022 Gold Raganato
  5. 5

    only a very short time before; ; ; ; ; - W.B.Yeats

    just%4:02:04:: · barely.r.01

    • they could barely hear the speaker
    • we hardly knew them

    Synonyms: barely, hardly, scarcely, scarce

  6. 6

    exactly at this moment or the moment described

    just%4:02:06:: · just.r.06

    • we've just finished painting the walls, so don't touch them

only Adv

Instance: senseval2.d000.s021.t003 Dataset: senseval2 Bucket: POS / ADV

Incorrect

It is easy to see why the ancient art is on the ropes.

The less complicated version of playing tunes on bells, as do the carillons of continental Europe, is considered by the English to be childish, fit only for foreigners.

Change-ringing, a mind-boggling exercise the English invented 380 years ago, requires physical dexterity -- some bells weigh more than a ton -- combined with intense mental concentration.

Proper English bells are started off in "rounds, "from the highest-pitched bell to the lowest -- a simple descending scale using, in larger churches, as many as 12 bells.

Then, at a signal, the ringers begin varying the order in which the bells sound without altering the steady rhythm of the striking.

Each variation, or change, can occur only once, the rules state.

Ringers memorize patterns of changes, known as "methods, "which have odd-sounding names like Kent Treble Bob Major or Grandsire Caters.

Show raw prompt

user

Which numbered sense of "only" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: It is easy to see why the ancient art is on the ropes. The less complicated version of playing tunes on bells, as do the carillons of continental Europe, is considered by the English to be childish, fit only for foreigners. Change-ringing, a mind-boggling exercise the English invented 380 years ago, requires physical dexterity -- some bells weigh more than a ton -- combined with intense mental concentration. Proper English bells are started off in "rounds, "from the highest-pitched bell to the lowest -- a simple descending scale using, in larger churches, as many as 12 bells. Then, at a signal, the ringers begin varying the order in which the bells sound without altering the steady rhythm of the striking. Each variation, or change, can occur <t>only</t> once, the rules state. Ringers memorize patterns of changes, known as "methods, "which have odd-sounding names like Kent Treble Bob Major or Grandsire Caters.

Senses:
1. definition=and nothing more | synonyms=merely, simply, just, but | examples=I was merely asking; it is simply a matter of time
2. definition=without any others being included or involved | synonyms=entirely, exclusively, solely, alone | examples=was entirely to blame; a school devoted entirely to the needs of problem children
3. definition=with nevertheless the final result | examples=He arrived only to find his wife dead; We won only to lose again in the next round
4. definition=in the final outcome | examples=These news will only make you more upset
5. definition=except that | examples=It was the same story; only this time she came out better
6. definition=never except when | synonyms=only if, only when | examples=call me only if your cold gets worse
7. definition=as recently as | examples=I spoke to him only an hour ago

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    and nothing more

    only%4:02:02:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, just, but

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    without any others being included or involved

    only%4:02:01:: · entirely.r.02

    • was entirely to blame
    • a school devoted entirely to the needs of problem children

    Synonyms: entirely, exclusively, solely, alone

    Selected
  3. 3

    with nevertheless the final result

    only%4:02:00:: · only.r.03

    • He arrived only to find his wife dead
    • We won only to lose again in the next round
  4. 4

    in the final outcome

    only%4:02:04:: · only.r.04

    • These news will only make you more upset
  5. 5

    except that

    only%4:02:06:: · only.r.05

    • It was the same story; only this time she came out better
  6. 6

    never except when

    only%4:02:03:: · only.r.06

    • call me only if your cold gets worse

    Synonyms: only if, only when

  7. 7

    as recently as

    only%4:02:05:: · only.r.07

    • I spoke to him only an hour ago

more Adv

Instance: senseval2.d000.s034.t000 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Skilled ringers use their wrists to advance or retard the next swing, so that one bell can swap places with another in the following change.

In a well-known detective-story involving church bells, English novelist Dorothy L. Sayers described ringing as a "passion that finds its satisfaction in mathematical completeness and mechanical perfection. "

Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""

Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers.

It is a passion that usually stays in the tower, however.

More often than not, ringers think of the church as something stuck on the bottom of the belfry.

When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below.

Show raw prompt

user

Which numbered sense of "more" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Skilled ringers use their wrists to advance or retard the next swing, so that one bell can swap places with another in the following change. In a well-known detective-story involving church bells, English novelist Dorothy L. Sayers described ringing as a "passion that finds its satisfaction in mathematical completeness and mechanical perfection. "Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers. It is a passion that usually stays in the tower, however. <t>More</t> often than not, ringers think of the church as something stuck on the bottom of the belfry. When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below.

Senses:
1. definition=used to form the comparative of some adjectives and adverbs | synonyms=to a greater extent | examples=more interesting; more beautiful
2. definition=comparative of much; to a greater degree or extent | examples=he works more now; they eat more than they should

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    used to form the comparative of some adjectives and adverbs

    more%4:02:00:: · more.r.01

    • more interesting
    • more beautiful

    Synonyms: to a greater extent

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    comparative of much; to a greater degree or extent

    more%4:02:01:: · more.r.02

    • he works more now
    • they eat more than they should
    Selected

below Adv

Instance: senseval2.d000.s035.t011 Dataset: senseval2 Bucket: POS / ADV

Incorrect

In a well-known detective-story involving church bells, English novelist Dorothy L. Sayers described ringing as a "passion that finds its satisfaction in mathematical completeness and mechanical perfection. "

Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""

Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers.

It is a passion that usually stays in the tower, however.

More often than not, ringers think of the church as something stuck on the bottom of the belfry.

When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below.

This does not sit well with some clerics.

Show raw prompt

user

Which numbered sense of "below" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: In a well-known detective-story involving church bells, English novelist Dorothy L. Sayers described ringing as a "passion that finds its satisfaction in mathematical completeness and mechanical perfection. "Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers. It is a passion that usually stays in the tower, however. More often than not, ringers think of the church as something stuck on the bottom of the belfry. When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others <t>below</t>. This does not sit well with some clerics.

Senses:
1. definition=in or to a place that is lower | synonyms=at a lower place, to a lower place, beneath
2. definition=at a later place | examples=see below
3. definition=(in writing) see below | synonyms=infra | examples=vide infra
4. definition=on a floor below | synonyms=downstairs, down the stairs, on a lower floor | examples=the tenants live downstairs
5. definition=further down | synonyms=under | examples=see under for further discussion

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    in or to a place that is lower

    below%4:02:01:: · below.r.01

    Synonyms: at a lower place, to a lower place, beneath

    Selected
  2. 2

    at a later place

    below%4:02:00:: · below.r.02

    • see below
  3. 3

    (in writing) see below

    below%4:02:02:: · below.r.03

    • vide infra

    Synonyms: infra

  4. 4

    on a floor below

    below%4:02:06:: · downstairs.r.01

    • the tenants live downstairs

    Synonyms: downstairs, down the stairs, on a lower floor

    Gold lexEN Gold Maru 2022 Gold Raganato
  5. 5

    further down

    below%4:02:03:: · under.r.08

    • see under for further discussion

    Synonyms: under

well Adv

Instance: senseval2.d000.s036.t000 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""

Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers.

It is a passion that usually stays in the tower, however.

More often than not, ringers think of the church as something stuck on the bottom of the belfry.

When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below.

This does not sit well with some clerics.

With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services.

Show raw prompt

user

Which numbered sense of "well" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers. It is a passion that usually stays in the tower, however. More often than not, ringers think of the church as something stuck on the bottom of the belfry. When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below. This does not sit <t>well</t> with some clerics. With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services.

Senses:
1. definition=(often used as a combining form) in a good or proper or satisfactory manner or to a high standard (`good' is a nonstandard dialectal variant for `well') | synonyms=good | examples=the children behaved well; a task well done
2. definition=thoroughly or completely; fully; often used as a combining form; ; ; ; ; , | examples=The problem is well understood; she was well informed
3. definition=indicating high probability; in all likelihood | synonyms=easily | examples=I might well do it; a mistake that could easily have ended in disaster
4. definition=(used for emphasis or as an intensifier) entirely or fully | examples=a book well worth reading; was well aware of the difficulties ahead
5. definition=to a suitable or appropriate extent or degree | examples=the project was well underway; the fetus has well developed organs
6. definition=favorably; with approval | examples=their neighbors spoke well of them; he thought well of the book
7. definition=to a great extent or degree | synonyms=considerably, substantially | examples=I'm afraid the film was well over budget; painting the room white made it seem considerably (or substantially) larger
8. definition=with great or especially intimate knowledge | synonyms=intimately | examples=we knew them well
9. definition=with prudence or propriety | examples=You would do well to say nothing more; could not well refuse
10. definition=with skill or in a pleasing manner | examples=she dances well; he writes well
11. definition=in a manner affording benefit or advantage | synonyms=advantageously | examples=she married well; The children were settled advantageously in Seattle
12. definition=in financial comfort | synonyms=comfortably | examples=They live well; she has been able to live comfortably since her husband died
13. definition=without unusual distress or resentment; with good humor | examples=took the joke well; took the tragic news well

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    (often used as a combining form) in a good or proper or satisfactory manner or to a high standard (`good' is a nonstandard dialectal variant for `well')

    well%4:02:00:: · well.r.01

    • the children behaved well
    • a task well done

    Synonyms: good

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    thoroughly or completely; fully; often used as a combining form; ; ; ; ; ,

    well%4:02:05:: · well.r.02

    • The problem is well understood
    • she was well informed
  3. 3

    indicating high probability; in all likelihood

    well%4:02:03:: · well.r.03

    • I might well do it
    • a mistake that could easily have ended in disaster

    Synonyms: easily

  4. 4

    (used for emphasis or as an intensifier) entirely or fully

    well%4:02:15:: · well.r.04

    • a book well worth reading
    • was well aware of the difficulties ahead
  5. 5

    to a suitable or appropriate extent or degree

    well%4:02:08:: · well.r.05

    • the project was well underway
    • the fetus has well developed organs
  6. 6

    favorably; with approval

    well%4:02:07:: · well.r.06

    • their neighbors spoke well of them
    • he thought well of the book
  7. 7

    to a great extent or degree

    well%4:02:11:: · well.r.07

    • I'm afraid the film was well over budget
    • painting the room white made it seem considerably (or substantially) larger

    Synonyms: considerably, substantially

  8. 8

    with great or especially intimate knowledge

    well%4:02:14:: · well.r.08

    • we knew them well

    Synonyms: intimately

  9. 9

    with prudence or propriety

    well%4:02:13:: · well.r.09

    • You would do well to say nothing more
    • could not well refuse
  10. 10

    with skill or in a pleasing manner

    well%4:02:12:: · well.r.10

    • she dances well
    • he writes well
  11. 11

    in a manner affording benefit or advantage

    well%4:02:10:: · well.r.11

    • she married well
    • The children were settled advantageously in Seattle

    Synonyms: advantageously

  12. 12

    in financial comfort

    well%4:02:09:: · well.r.12

    • They live well
    • she has been able to live comfortably since her husband died

    Synonyms: comfortably

  13. 13

    without unusual distress or resentment; with good humor

    well%4:02:01:: · well.r.13

    • took the joke well
    • took the tragic news well
    Selected

so Adv

Instance: senseval2.d000.s045.t000 Dataset: senseval2 Bucket: POS / ADV

Incorrect

An entirely new band rings today at Great Torrington, several of whom are members of the congregation.

But there still are not enough ringers to ring more than six of the eight bells.

At St. Mary's Church in Ilminster, Somerset, the bells have fallen silent following a dust-up over church attendance.

The vicar, W.D. Jones, refuses to talk about it, saying it would "reopen the wound. "

But C.J.B. Marshall, vicar of a nearby church, feels the fault is in the stairs from the bell tower that are located next to the altar.

"So crunch, crunch, crunch, bang, bang, bang -- here come the ringers from above, making a very obvious exit while the congregation is at prayer, "he says.

Vicar Marshall admits to mixed feelings about this issue, since he is both a vicar and an active bell-ringer himself.

Show raw prompt

user

Which numbered sense of "so" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: An entirely new band rings today at Great Torrington, several of whom are members of the congregation. But there still are not enough ringers to ring more than six of the eight bells. At St. Mary's Church in Ilminster, Somerset, the bells have fallen silent following a dust-up over church attendance. The vicar, W.D. Jones, refuses to talk about it, saying it would "reopen the wound. "But C.J.B. Marshall, vicar of a nearby church, feels the fault is in the stairs from the bell tower that are located next to the altar. "<t>So</t> crunch, crunch, crunch, bang, bang, bang -- here come the ringers from above, making a very obvious exit while the congregation is at prayer, "he says. Vicar Marshall admits to mixed feelings about this issue, since he is both a vicar and an active bell-ringer himself.

Senses:
1. definition=to a very great extent or degree | examples=the idea is so obvious; never been so happy
2. definition=in a manner that facilitates | examples=he observed the snakes so he could describe their behavior; he stooped down so he could pick up his hat
3. definition=in such a condition or manner, especially as expressed or implied | examples=They're happy and I hope they will remain so; so live your life that old age will bring no regrets
4. definition=to a certain unspecified extent or degree | examples=I can only go so far with this student; can do only so much in a day
5. definition=in the same way; also | examples=I was offended and so was he; worked hard and so did she
6. definition=in the way indicated; ; ; (`thusly' is a nonstandard variant) | synonyms=thus, thusly | examples=hold the brush so; set up the pieces thus
7. definition=(usually followed by `that') to an extent or degree as expressed | examples=he was so tired he could hardly stand; so dirty that it smells
8. definition=subsequently or soon afterward (often used as sentence connectors) | synonyms=then, and so, and then | examples=then he left; go left first, then right
9. definition=(used to introduce a logical conclusion) from that fact or reason or as a result | synonyms=therefore, hence, thence, thus | examples=therefore X must be true; the eggs were fresh and hence satisfactory
10. definition=in truth (often tends to intensify) | synonyms=indeed | examples=they said the car would break down and indeed it did; it is very cold indeed

Prediction matches gold: lexEN ✗ Maru 2022 ✓ Raganato ✓

WordNet 3.0 senses

  1. 1

    to a very great extent or degree

    so%4:02:02:: · so.r.01

    • the idea is so obvious
    • never been so happy
  2. 2

    in a manner that facilitates

    so%4:02:06:: · so.r.02

    • he observed the snakes so he could describe their behavior
    • he stooped down so he could pick up his hat
  3. 3

    in such a condition or manner, especially as expressed or implied

    so%4:02:05:: · so.r.03

    • They're happy and I hope they will remain so
    • so live your life that old age will bring no regrets
  4. 4

    to a certain unspecified extent or degree

    so%4:02:07:: · so.r.04

    • I can only go so far with this student
    • can do only so much in a day
  5. 5

    in the same way; also

    so%4:02:08:: · so.r.05

    • I was offended and so was he
    • worked hard and so did she
  6. 6

    in the way indicated; ; ; (`thusly' is a nonstandard variant)

    so%4:02:04:: · thus.r.02

    • hold the brush so
    • set up the pieces thus

    Synonyms: thus, thusly

  7. 7

    (usually followed by `that') to an extent or degree as expressed

    so%4:02:03:: · so.r.07

    • he was so tired he could hardly stand
    • so dirty that it smells
  8. 8

    subsequently or soon afterward (often used as sentence connectors)

    so%4:02:09:: · then.r.01

    • then he left
    • go left first, then right

    Synonyms: then, and so, and then

    Gold Maru 2022 Gold Raganato Selected
  9. 9

    (used to introduce a logical conclusion) from that fact or reason or as a result

    so%4:02:10:: · therefore.r.01

    • therefore X must be true
    • the eggs were fresh and hence satisfactory

    Synonyms: therefore, hence, thence, thus

    Gold lexEN
  10. 10

    in truth (often tends to intensify)

    so%4:02:00:: · indeed.r.01

    • they said the car would break down and indeed it did
    • it is very cold indeed

    Synonyms: indeed