Verified run

gpt-5.5

gpt-5.5-low-reasoning-p003-lexen-v1-20260616

Rank
7
Accuracy lexEN v1 · WordNet fine
95.00%
Correct
4618 / 4861
Actual run cost
$17.09
Cost / M items
$3,516

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 95.00% 4618 / 4861 98.56% 4791 / 4861 96.73% 4702 / 4861
Maru 2022 (ALLamended) 91.40% 4443 / 4861 97.39% 4734 / 4861 94.45% 4591 / 4861
Raganato 2017 (original) 84.94% 4129 / 4861 94.55% 4596 / 4861 90.39% 4394 / 4861

Model

Display
gpt-5.5
Requested
gpt-5.5
Resolved
gpt-5.5-2026-04-23
Vendor
OpenAI
API provider
OpenAI
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
low
Model URL
n/a
Endpoint
n/a
Resolved counts
gpt-5.5-2026-04-23: 4861

Reproducibility

Created
2026-06-16T02:01:57.439526+00:00
Run schema
sensebench-run-v2
Commit
5b012ea5d171aa1bd85b19f9ecd80276014f38d9
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p003
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
2,484,619
Tokens / item
511.1
Total cost
$17.09
Cost / M items
$3,516
Cost source
litellm_estimate
Elapsed
56.79s
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
12,288
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $17.09. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 2,080,031 $10.40 $5.00
Input cached 0 $0.00 $0.500
Output 223,002 $6.69 $30.00
Reasoning output 181,586 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 93.20% 740 794
Candidate Count 2 96.96% 829 855
Candidate Count 3-5 95.37% 1855 1945
Candidate Count 6-10 94.24% 1194 1267
POS ADJ 93.93% 619 659
POS ADV 91.79% 179 195
POS NOUN 95.62% 2770 2897
POS VERB 94.59% 1050 1110
Source Dataset semeval2013 96.67% 1102 1140
Source Dataset semeval2015 93.78% 693 739
Source Dataset senseval2 95.15% 1550 1629
Source Dataset senseval3 94.09% 1273 1353

Worst-Bucket Examples

only Adv

Instance: semeval2015.d003.s019.t003 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

A large number of studies with Cerenia were carried out either in laboratory dogs or in animal patients at veterinary practises in several European countries and in the USA.

What benefit has Cerenia shown during the studies?

The results of the studies showed that Cerenia was more effective than the placebo: less vomiting was seen in dogs that received the medicine than in dogs that received a placebo, both in the treatment or in the prevention of vomiting.

The treatment of a vomiting dog should be started with the injection, since vomiting animals might not be able to keep a tablet down (as they might throw the intact tablet up again).

For follow-up treatment, the animal owner can administer the tablets to the dog.

Also, the treatment of vomiting should only be together with other supportive measure or other veterinary therapy while addressing the underlying causes of the vomiting.

What is the risk associated with Cerenia?

Show raw prompt

user

Which numbered sense of "only" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: A large number of studies with Cerenia were carried out either in laboratory dogs or in animal patients at veterinary practises in several European countries and in the USA. What benefit has Cerenia shown during the studies? The results of the studies showed that Cerenia was more effective than the placebo: less vomiting was seen in dogs that received the medicine than in dogs that received a placebo, both in the treatment or in the prevention of vomiting. The treatment of a vomiting dog should be started with the injection, since vomiting animals might not be able to keep a tablet down (as they might throw the intact tablet up again). For follow-up treatment, the animal owner can administer the tablets to the dog. Also, the treatment of vomiting should <t>only</t> be together with other supportive measure or other veterinary therapy while addressing the underlying causes of the vomiting. What is the risk associated with Cerenia?

Senses:
1. definition=and nothing more | synonyms=merely, simply, just, but | examples=I was merely asking; it is simply a matter of time
2. definition=without any others being included or involved | synonyms=entirely, exclusively, solely, alone | examples=was entirely to blame; a school devoted entirely to the needs of problem children
3. definition=with nevertheless the final result | examples=He arrived only to find his wife dead; We won only to lose again in the next round
4. definition=in the final outcome | examples=These news will only make you more upset
5. definition=except that | examples=It was the same story; only this time she came out better
6. definition=never except when | synonyms=only if, only when | examples=call me only if your cold gets worse
7. definition=as recently as | examples=I spoke to him only an hour ago

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    and nothing more

    only%4:02:02:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, just, but

  2. 2

    without any others being included or involved

    only%4:02:01:: · entirely.r.02

    • was entirely to blame
    • a school devoted entirely to the needs of problem children

    Synonyms: entirely, exclusively, solely, alone

    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    with nevertheless the final result

    only%4:02:00:: · only.r.03

    • He arrived only to find his wife dead
    • We won only to lose again in the next round
  4. 4

    in the final outcome

    only%4:02:04:: · only.r.04

    • These news will only make you more upset
  5. 5

    except that

    only%4:02:06:: · only.r.05

    • It was the same story; only this time she came out better
  6. 6

    never except when

    only%4:02:03:: · only.r.06

    • call me only if your cold gets worse

    Synonyms: only if, only when

    Selected
  7. 7

    as recently as

    only%4:02:05:: · only.r.07

    • I spoke to him only an hour ago

well Adv

Instance: semeval2015.d003.s021.t001 Dataset: semeval2015 Bucket: POS / ADV

Incorrect

The results of the studies showed that Cerenia was more effective than the placebo: less vomiting was seen in dogs that received the medicine than in dogs that received a placebo, both in the treatment or in the prevention of vomiting.

The treatment of a vomiting dog should be started with the injection, since vomiting animals might not be able to keep a tablet down (as they might throw the intact tablet up again).

For follow-up treatment, the animal owner can administer the tablets to the dog.

Also, the treatment of vomiting should only be together with other supportive measure or other veterinary therapy while addressing the underlying causes of the vomiting.

What is the risk associated with Cerenia?

Cerenia was generally well tolerated when administered daily at dosages up to 5 times the recommended doses for an extended period of time (up to 3 times the recommended maximum duration of treatment).

What are the precautions for the person who gives the medicine or comes into contact with the animal?

Show raw prompt

user

Which numbered sense of "well" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: The results of the studies showed that Cerenia was more effective than the placebo: less vomiting was seen in dogs that received the medicine than in dogs that received a placebo, both in the treatment or in the prevention of vomiting. The treatment of a vomiting dog should be started with the injection, since vomiting animals might not be able to keep a tablet down (as they might throw the intact tablet up again). For follow-up treatment, the animal owner can administer the tablets to the dog. Also, the treatment of vomiting should only be together with other supportive measure or other veterinary therapy while addressing the underlying causes of the vomiting. What is the risk associated with Cerenia? Cerenia was generally <t>well</t> tolerated when administered daily at dosages up to 5 times the recommended doses for an extended period of time (up to 3 times the recommended maximum duration of treatment). What are the precautions for the person who gives the medicine or comes into contact with the animal?

Senses:
1. definition=(often used as a combining form) in a good or proper or satisfactory manner or to a high standard (`good' is a nonstandard dialectal variant for `well') | synonyms=good | examples=the children behaved well; a task well done
2. definition=thoroughly or completely; fully; often used as a combining form; ; ; ; ; , | examples=The problem is well understood; she was well informed
3. definition=indicating high probability; in all likelihood | synonyms=easily | examples=I might well do it; a mistake that could easily have ended in disaster
4. definition=(used for emphasis or as an intensifier) entirely or fully | examples=a book well worth reading; was well aware of the difficulties ahead
5. definition=to a suitable or appropriate extent or degree | examples=the project was well underway; the fetus has well developed organs
6. definition=favorably; with approval | examples=their neighbors spoke well of them; he thought well of the book
7. definition=to a great extent or degree | synonyms=considerably, substantially | examples=I'm afraid the film was well over budget; painting the room white made it seem considerably (or substantially) larger
8. definition=with great or especially intimate knowledge | synonyms=intimately | examples=we knew them well
9. definition=with prudence or propriety | examples=You would do well to say nothing more; could not well refuse
10. definition=with skill or in a pleasing manner | examples=she dances well; he writes well
11. definition=in a manner affording benefit or advantage | synonyms=advantageously | examples=she married well; The children were settled advantageously in Seattle
12. definition=in financial comfort | synonyms=comfortably | examples=They live well; she has been able to live comfortably since her husband died
13. definition=without unusual distress or resentment; with good humor | examples=took the joke well; took the tragic news well

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    (often used as a combining form) in a good or proper or satisfactory manner or to a high standard (`good' is a nonstandard dialectal variant for `well')

    well%4:02:00:: · well.r.01

    • the children behaved well
    • a task well done

    Synonyms: good

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    thoroughly or completely; fully; often used as a combining form; ; ; ; ; ,

    well%4:02:05:: · well.r.02

    • The problem is well understood
    • she was well informed
  3. 3

    indicating high probability; in all likelihood

    well%4:02:03:: · well.r.03

    • I might well do it
    • a mistake that could easily have ended in disaster

    Synonyms: easily

  4. 4

    (used for emphasis or as an intensifier) entirely or fully

    well%4:02:15:: · well.r.04

    • a book well worth reading
    • was well aware of the difficulties ahead
  5. 5

    to a suitable or appropriate extent or degree

    well%4:02:08:: · well.r.05

    • the project was well underway
    • the fetus has well developed organs
  6. 6

    favorably; with approval

    well%4:02:07:: · well.r.06

    • their neighbors spoke well of them
    • he thought well of the book
  7. 7

    to a great extent or degree

    well%4:02:11:: · well.r.07

    • I'm afraid the film was well over budget
    • painting the room white made it seem considerably (or substantially) larger

    Synonyms: considerably, substantially

  8. 8

    with great or especially intimate knowledge

    well%4:02:14:: · well.r.08

    • we knew them well

    Synonyms: intimately

  9. 9

    with prudence or propriety

    well%4:02:13:: · well.r.09

    • You would do well to say nothing more
    • could not well refuse
  10. 10

    with skill or in a pleasing manner

    well%4:02:12:: · well.r.10

    • she dances well
    • he writes well
  11. 11

    in a manner affording benefit or advantage

    well%4:02:10:: · well.r.11

    • she married well
    • The children were settled advantageously in Seattle

    Synonyms: advantageously

  12. 12

    in financial comfort

    well%4:02:09:: · well.r.12

    • They live well
    • she has been able to live comfortably since her husband died

    Synonyms: comfortably

  13. 13

    without unusual distress or resentment; with good humor

    well%4:02:01:: · well.r.13

    • took the joke well
    • took the tragic news well
    Selected

now Adv

Instance: senseval2.d000.s008.t000 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong.

The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have.

In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614.

But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening.

Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service.

Now, only one local ringer remains: 64-year-old Derek Hammond.

The others here today live elsewhere.

Show raw prompt

user

Which numbered sense of "now" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong. The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have. In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614. But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening. Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service. <t>Now</t>, only one local ringer remains: 64-year-old Derek Hammond. The others here today live elsewhere.

Senses:
1. definition=in the historical present; at this point in the narration of a series of past events | examples=President Kennedy now calls in the National Guard; Washington now decides to cross the Delaware
2. definition=in these times; - Nancy Mitford | synonyms=nowadays, today | examples=it is solely by their language that the upper classes nowadays are distinguished; we now rarely see horse-drawn vehicles on city streets
3. definition=used to preface a command or reproof or request | examples=now hear this!; now pay attention
4. definition=at the present moment | synonyms=at present | examples=goods now on sale; the now-aging dictator
5. definition=without delay or hesitation; with no time intervening | synonyms=immediately, instantly, straightaway, straight off, directly, right away | examples=he answered immediately; found an answer straightaway
6. definition=(prefatory or transitional) indicates a change of subject or activity | examples=Now the next problem is...
7. definition=in the immediate past | examples=told me just now

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    in the historical present; at this point in the narration of a series of past events

    now%4:02:05:: · now.r.01

    • President Kennedy now calls in the National Guard
    • Washington now decides to cross the Delaware
  2. 2

    in these times; - Nancy Mitford

    now%4:02:00:: · nowadays.r.01

    • it is solely by their language that the upper classes nowadays are distinguished
    • we now rarely see horse-drawn vehicles on city streets

    Synonyms: nowadays, today

    Gold Raganato Selected
  3. 3

    used to preface a command or reproof or request

    now%4:02:02:: · now.r.03

    • now hear this!
    • now pay attention
  4. 4

    at the present moment

    now%4:02:04:: · now.r.04

    • goods now on sale
    • the now-aging dictator

    Synonyms: at present

    Gold lexEN Gold Maru 2022
  5. 5

    without delay or hesitation; with no time intervening

    now%4:02:01:: · immediately.r.01

    • he answered immediately
    • found an answer straightaway

    Synonyms: immediately, instantly, straightaway, straight off, directly, right away, at once, forthwith, like a shot

  6. 6

    (prefatory or transitional) indicates a change of subject or activity

    now%4:02:07:: · now.r.06

    • Now the next problem is...
  7. 7

    in the immediate past

    now%4:02:06:: · now.r.07

    • told me just now

only Adv

Instance: senseval2.d000.s008.t001 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong.

The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have.

In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614.

But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening.

Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service.

Now, only one local ringer remains: 64-year-old Derek Hammond.

The others here today live elsewhere.

Show raw prompt

user

Which numbered sense of "only" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong. The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have. In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614. But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening. Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service. Now, <t>only</t> one local ringer remains: 64-year-old Derek Hammond. The others here today live elsewhere.

Senses:
1. definition=and nothing more | synonyms=merely, simply, just, but | examples=I was merely asking; it is simply a matter of time
2. definition=without any others being included or involved | synonyms=entirely, exclusively, solely, alone | examples=was entirely to blame; a school devoted entirely to the needs of problem children
3. definition=with nevertheless the final result | examples=He arrived only to find his wife dead; We won only to lose again in the next round
4. definition=in the final outcome | examples=These news will only make you more upset
5. definition=except that | examples=It was the same story; only this time she came out better
6. definition=never except when | synonyms=only if, only when | examples=call me only if your cold gets worse
7. definition=as recently as | examples=I spoke to him only an hour ago

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    and nothing more

    only%4:02:02:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, just, but

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    without any others being included or involved

    only%4:02:01:: · entirely.r.02

    • was entirely to blame
    • a school devoted entirely to the needs of problem children

    Synonyms: entirely, exclusively, solely, alone

    Selected
  3. 3

    with nevertheless the final result

    only%4:02:00:: · only.r.03

    • He arrived only to find his wife dead
    • We won only to lose again in the next round
  4. 4

    in the final outcome

    only%4:02:04:: · only.r.04

    • These news will only make you more upset
  5. 5

    except that

    only%4:02:06:: · only.r.05

    • It was the same story; only this time she came out better
  6. 6

    never except when

    only%4:02:03:: · only.r.06

    • call me only if your cold gets worse

    Synonyms: only if, only when

  7. 7

    as recently as

    only%4:02:05:: · only.r.07

    • I spoke to him only an hour ago

just Adv

Instance: senseval2.d000.s012.t005 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service.

Now, only one local ringer remains: 64-year-old Derek Hammond.

The others here today live elsewhere.

They belong to a group of 15 ringers -- including two octogenarians and four youngsters in training -- who drive every Sunday from church to church in a sometimes-exhausting effort to keep the bells sounding in the many belfries of East Anglia.

"To ring for even one service at this tower, we have to scrape, "says Mr. Hammond, a retired water-authority worker. "

We've tried to train the youngsters, but they have their discos and their dances, and they just drift away. "

Mr. Hammond worries that old age and the flightiness of youth will diminish the ranks of the East Anglian group that keeps the Aslacton bells pealing.

Show raw prompt

user

Which numbered sense of "just" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service. Now, only one local ringer remains: 64-year-old Derek Hammond. The others here today live elsewhere. They belong to a group of 15 ringers -- including two octogenarians and four youngsters in training -- who drive every Sunday from church to church in a sometimes-exhausting effort to keep the bells sounding in the many belfries of East Anglia. "To ring for even one service at this tower, we have to scrape, "says Mr. Hammond, a retired water-authority worker. "We've tried to train the youngsters, but they have their discos and their dances, and they <t>just</t> drift away. "Mr. Hammond worries that old age and the flightiness of youth will diminish the ranks of the East Anglian group that keeps the Aslacton bells pealing.

Senses:
1. definition=and nothing more | synonyms=merely, simply, only, but | examples=I was merely asking; it is simply a matter of time
2. definition=indicating exactness or preciseness | synonyms=precisely, exactly | examples=he was doing precisely (or exactly) what she had told him to do; it was just as he said--the jewel was gone
3. definition=only a moment ago | synonyms=just now | examples=he has just arrived; the sun just now came out
4. definition=absolutely | synonyms=simply | examples=I just can't take it anymore; he was just grand as Romeo
5. definition=only a very short time before; ; ; ; ; - W.B.Yeats | synonyms=barely, hardly, scarcely, scarce | examples=they could barely hear the speaker; we hardly knew them
6. definition=exactly at this moment or the moment described | examples=we've just finished painting the walls, so don't touch them

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    and nothing more

    just%4:02:00:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, only, but

    Selected
  2. 2

    indicating exactness or preciseness

    just%4:02:05:: · precisely.r.01

    • he was doing precisely (or exactly) what she had told him to do
    • it was just as he said--the jewel was gone

    Synonyms: precisely, exactly

  3. 3

    only a moment ago

    just%4:02:01:: · just.r.03

    • he has just arrived
    • the sun just now came out

    Synonyms: just now

  4. 4

    absolutely

    just%4:02:03:: · just.r.04

    • I just can't take it anymore
    • he was just grand as Romeo

    Synonyms: simply

    Gold lexEN Gold Maru 2022 Gold Raganato
  5. 5

    only a very short time before; ; ; ; ; - W.B.Yeats

    just%4:02:04:: · barely.r.01

    • they could barely hear the speaker
    • we hardly knew them

    Synonyms: barely, hardly, scarcely, scarce

  6. 6

    exactly at this moment or the moment described

    just%4:02:06:: · just.r.06

    • we've just finished painting the walls, so don't touch them

ahead Adv

Instance: senseval2.d000.s027.t005 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Ringers memorize patterns of changes, known as "methods, "which have odd-sounding names like Kent Treble Bob Major or Grandsire Caters.

A series of 5,000 or so changes is a "peal "and takes about three hours.

A look at a Thursday night practice at St. Mary Abbot church in the Kensington district of London gives an idea of the work involved.

Ten shirt-sleeved ringers stand in a circle, one foot ahead of the other in a prize-fighter's stance, each pulling a rope that disappears through a small hole in the high ceiling of the ringing chamber.

No one speaks, and the snaking of the ropes seems to make as much sound as the bells themselves, muffled by the ceiling.

Totally absorbed, the ringers stare straight ahead, using peripheral vision (they call it "rope-sight ") to watch the other ropes and thus time their pulls.

Far above in the belfry, the huge bronze bells, mounted on wheels, swing madly through a full 360 degrees, starting and ending, surprisingly, in the inverted, or mouth-up position.

Show raw prompt

user

Which numbered sense of "ahead" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Ringers memorize patterns of changes, known as "methods, "which have odd-sounding names like Kent Treble Bob Major or Grandsire Caters. A series of 5,000 or so changes is a "peal "and takes about three hours. A look at a Thursday night practice at St. Mary Abbot church in the Kensington district of London gives an idea of the work involved. Ten shirt-sleeved ringers stand in a circle, one foot ahead of the other in a prize-fighter's stance, each pulling a rope that disappears through a small hole in the high ceiling of the ringing chamber. No one speaks, and the snaking of the ropes seems to make as much sound as the bells themselves, muffled by the ceiling. Totally absorbed, the ringers stare straight <t>ahead</t>, using peripheral vision (they call it "rope-sight ") to watch the other ropes and thus time their pulls. Far above in the belfry, the huge bronze bells, mounted on wheels, swing madly through a full 360 degrees, starting and ending, surprisingly, in the inverted, or mouth-up position.

Senses:
1. definition=at or in the front | synonyms=in front, before | examples=I see the lights of a town ahead; the road ahead is foggy
2. definition=toward the future; forward in time | synonyms=forward | examples=I like to look ahead in imagination to what the future may bring; I look forward to seeing you
3. definition=in a forward direction | synonyms=onward, onwards, forward, forwards, forrader | examples=go ahead; the train moved ahead slowly
4. definition=ahead of time; in anticipation | synonyms=in advance, beforehand | examples=when you pay ahead (or in advance) you receive a discount; We like to plan ahead
5. definition=to a more advanced or advantageous position | examples=a young man sure to get ahead; pushing talented students ahead
6. definition=to a different or a more advanced time (meaning advanced either toward the present or toward the future) | examples=moved the appointment ahead from Tuesday to Monday; pushed the deadline ahead from Tuesday to Wednesday
7. definition=leading or ahead in a competition | synonyms=out front, in the lead | examples=the horse was three lengths ahead going into the home stretch; ahead by two pawns

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    at or in the front

    ahead%4:02:00:: · ahead.r.01

    • I see the lights of a town ahead
    • the road ahead is foggy

    Synonyms: in front, before

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    toward the future; forward in time

    ahead%4:02:06:: · ahead.r.02

    • I like to look ahead in imagination to what the future may bring
    • I look forward to seeing you

    Synonyms: forward

  3. 3

    in a forward direction

    ahead%4:02:02:: · ahead.r.03

    • go ahead
    • the train moved ahead slowly

    Synonyms: onward, onwards, forward, forwards, forrader

    Selected
  4. 4

    ahead of time; in anticipation

    ahead%4:02:01:: · ahead.r.04

    • when you pay ahead (or in advance) you receive a discount
    • We like to plan ahead

    Synonyms: in advance, beforehand

  5. 5

    to a more advanced or advantageous position

    ahead%4:02:05:: · ahead.r.05

    • a young man sure to get ahead
    • pushing talented students ahead
  6. 6

    to a different or a more advanced time (meaning advanced either toward the present or toward the future)

    ahead%4:02:04:: · ahead.r.06

    • moved the appointment ahead from Tuesday to Monday
    • pushed the deadline ahead from Tuesday to Wednesday
  7. 7

    leading or ahead in a competition

    ahead%4:02:03:: · ahead.r.07

    • the horse was three lengths ahead going into the home stretch
    • ahead by two pawns

    Synonyms: out front, in the lead

thus Adv

Instance: senseval2.d000.s027.t012 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Ringers memorize patterns of changes, known as "methods, "which have odd-sounding names like Kent Treble Bob Major or Grandsire Caters.

A series of 5,000 or so changes is a "peal "and takes about three hours.

A look at a Thursday night practice at St. Mary Abbot church in the Kensington district of London gives an idea of the work involved.

Ten shirt-sleeved ringers stand in a circle, one foot ahead of the other in a prize-fighter's stance, each pulling a rope that disappears through a small hole in the high ceiling of the ringing chamber.

No one speaks, and the snaking of the ropes seems to make as much sound as the bells themselves, muffled by the ceiling.

Totally absorbed, the ringers stare straight ahead, using peripheral vision (they call it "rope-sight ") to watch the other ropes and thus time their pulls.

Far above in the belfry, the huge bronze bells, mounted on wheels, swing madly through a full 360 degrees, starting and ending, surprisingly, in the inverted, or mouth-up position.

Show raw prompt

user

Which numbered sense of "thus" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Ringers memorize patterns of changes, known as "methods, "which have odd-sounding names like Kent Treble Bob Major or Grandsire Caters. A series of 5,000 or so changes is a "peal "and takes about three hours. A look at a Thursday night practice at St. Mary Abbot church in the Kensington district of London gives an idea of the work involved. Ten shirt-sleeved ringers stand in a circle, one foot ahead of the other in a prize-fighter's stance, each pulling a rope that disappears through a small hole in the high ceiling of the ringing chamber. No one speaks, and the snaking of the ropes seems to make as much sound as the bells themselves, muffled by the ceiling. Totally absorbed, the ringers stare straight ahead, using peripheral vision (they call it "rope-sight ") to watch the other ropes and <t>thus</t> time their pulls. Far above in the belfry, the huge bronze bells, mounted on wheels, swing madly through a full 360 degrees, starting and ending, surprisingly, in the inverted, or mouth-up position.

Senses:
1. definition=(used to introduce a logical conclusion) from that fact or reason or as a result | synonyms=therefore, hence, thence, so | examples=therefore X must be true; the eggs were fresh and hence satisfactory
2. definition=in the way indicated; ; ; (`thusly' is a nonstandard variant) | synonyms=thusly, so | examples=hold the brush so; set up the pieces thus

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    (used to introduce a logical conclusion) from that fact or reason or as a result

    thus%4:02:00:: · therefore.r.01

    • therefore X must be true
    • the eggs were fresh and hence satisfactory

    Synonyms: therefore, hence, thence, so

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    in the way indicated; ; ; (`thusly' is a nonstandard variant)

    thus%4:02:01:: · thus.r.02

    • hold the brush so
    • set up the pieces thus

    Synonyms: thusly, so

    Selected

below Adv

Instance: senseval2.d000.s035.t011 Dataset: senseval2 Bucket: POS / ADV

Incorrect

In a well-known detective-story involving church bells, English novelist Dorothy L. Sayers described ringing as a "passion that finds its satisfaction in mathematical completeness and mechanical perfection. "

Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""

Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers.

It is a passion that usually stays in the tower, however.

More often than not, ringers think of the church as something stuck on the bottom of the belfry.

When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below.

This does not sit well with some clerics.

Show raw prompt

user

Which numbered sense of "below" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: In a well-known detective-story involving church bells, English novelist Dorothy L. Sayers described ringing as a "passion that finds its satisfaction in mathematical completeness and mechanical perfection. "Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers. It is a passion that usually stays in the tower, however. More often than not, ringers think of the church as something stuck on the bottom of the belfry. When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others <t>below</t>. This does not sit well with some clerics.

Senses:
1. definition=in or to a place that is lower | synonyms=at a lower place, to a lower place, beneath
2. definition=at a later place | examples=see below
3. definition=(in writing) see below | synonyms=infra | examples=vide infra
4. definition=on a floor below | synonyms=downstairs, down the stairs, on a lower floor | examples=the tenants live downstairs
5. definition=further down | synonyms=under | examples=see under for further discussion

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    in or to a place that is lower

    below%4:02:01:: · below.r.01

    Synonyms: at a lower place, to a lower place, beneath

    Selected
  2. 2

    at a later place

    below%4:02:00:: · below.r.02

    • see below
  3. 3

    (in writing) see below

    below%4:02:02:: · below.r.03

    • vide infra

    Synonyms: infra

  4. 4

    on a floor below

    below%4:02:06:: · downstairs.r.01

    • the tenants live downstairs

    Synonyms: downstairs, down the stairs, on a lower floor

    Gold lexEN Gold Maru 2022 Gold Raganato
  5. 5

    further down

    below%4:02:03:: · under.r.08

    • see under for further discussion

    Synonyms: under

well Adv

Instance: senseval2.d000.s036.t000 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""

Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers.

It is a passion that usually stays in the tower, however.

More often than not, ringers think of the church as something stuck on the bottom of the belfry.

When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below.

This does not sit well with some clerics.

With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services.

Show raw prompt

user

Which numbered sense of "well" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers. It is a passion that usually stays in the tower, however. More often than not, ringers think of the church as something stuck on the bottom of the belfry. When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below. This does not sit <t>well</t> with some clerics. With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services.

Senses:
1. definition=(often used as a combining form) in a good or proper or satisfactory manner or to a high standard (`good' is a nonstandard dialectal variant for `well') | synonyms=good | examples=the children behaved well; a task well done
2. definition=thoroughly or completely; fully; often used as a combining form; ; ; ; ; , | examples=The problem is well understood; she was well informed
3. definition=indicating high probability; in all likelihood | synonyms=easily | examples=I might well do it; a mistake that could easily have ended in disaster
4. definition=(used for emphasis or as an intensifier) entirely or fully | examples=a book well worth reading; was well aware of the difficulties ahead
5. definition=to a suitable or appropriate extent or degree | examples=the project was well underway; the fetus has well developed organs
6. definition=favorably; with approval | examples=their neighbors spoke well of them; he thought well of the book
7. definition=to a great extent or degree | synonyms=considerably, substantially | examples=I'm afraid the film was well over budget; painting the room white made it seem considerably (or substantially) larger
8. definition=with great or especially intimate knowledge | synonyms=intimately | examples=we knew them well
9. definition=with prudence or propriety | examples=You would do well to say nothing more; could not well refuse
10. definition=with skill or in a pleasing manner | examples=she dances well; he writes well
11. definition=in a manner affording benefit or advantage | synonyms=advantageously | examples=she married well; The children were settled advantageously in Seattle
12. definition=in financial comfort | synonyms=comfortably | examples=They live well; she has been able to live comfortably since her husband died
13. definition=without unusual distress or resentment; with good humor | examples=took the joke well; took the tragic news well

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    (often used as a combining form) in a good or proper or satisfactory manner or to a high standard (`good' is a nonstandard dialectal variant for `well')

    well%4:02:00:: · well.r.01

    • the children behaved well
    • a task well done

    Synonyms: good

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    thoroughly or completely; fully; often used as a combining form; ; ; ; ; ,

    well%4:02:05:: · well.r.02

    • The problem is well understood
    • she was well informed
  3. 3

    indicating high probability; in all likelihood

    well%4:02:03:: · well.r.03

    • I might well do it
    • a mistake that could easily have ended in disaster

    Synonyms: easily

  4. 4

    (used for emphasis or as an intensifier) entirely or fully

    well%4:02:15:: · well.r.04

    • a book well worth reading
    • was well aware of the difficulties ahead
  5. 5

    to a suitable or appropriate extent or degree

    well%4:02:08:: · well.r.05

    • the project was well underway
    • the fetus has well developed organs
  6. 6

    favorably; with approval

    well%4:02:07:: · well.r.06

    • their neighbors spoke well of them
    • he thought well of the book
    Selected
  7. 7

    to a great extent or degree

    well%4:02:11:: · well.r.07

    • I'm afraid the film was well over budget
    • painting the room white made it seem considerably (or substantially) larger

    Synonyms: considerably, substantially

  8. 8

    with great or especially intimate knowledge

    well%4:02:14:: · well.r.08

    • we knew them well

    Synonyms: intimately

  9. 9

    with prudence or propriety

    well%4:02:13:: · well.r.09

    • You would do well to say nothing more
    • could not well refuse
  10. 10

    with skill or in a pleasing manner

    well%4:02:12:: · well.r.10

    • she dances well
    • he writes well
  11. 11

    in a manner affording benefit or advantage

    well%4:02:10:: · well.r.11

    • she married well
    • The children were settled advantageously in Seattle

    Synonyms: advantageously

  12. 12

    in financial comfort

    well%4:02:09:: · well.r.12

    • They live well
    • she has been able to live comfortably since her husband died

    Synonyms: comfortably

  13. 13

    without unusual distress or resentment; with good humor

    well%4:02:01:: · well.r.13

    • took the joke well
    • took the tragic news well

no Adv

Instance: senseval2.d000.s051.t003 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Vicar Marshall admits to mixed feelings about this issue, since he is both a vicar and an active bell-ringer himself.

"The sound of bells is a net to draw people into the church, "he says.

"I live in hopes that the ringers themselves will be drawn into that fuller life. "

The Central Council of Church Bell Ringers, a sort of parliament of ringing groups, aims to improve relations with vicars, says John C. Baldwin, president.

It hopes to speak to students at theological colleges about the joys of bell ringing and will shortly publish a booklet for every vicar in the country entitled, "The Bells in Your Care. "

Says Mr. Baldwin, "We recognize that we may no longer have as high a priority in church life and experience. "

Mr. Baldwin is also attacking the greater problem: lack of ringers.

Show raw prompt

user

Which numbered sense of "no" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Vicar Marshall admits to mixed feelings about this issue, since he is both a vicar and an active bell-ringer himself. "The sound of bells is a net to draw people into the church, "he says. "I live in hopes that the ringers themselves will be drawn into that fuller life. "The Central Council of Church Bell Ringers, a sort of parliament of ringing groups, aims to improve relations with vicars, says John C. Baldwin, president. It hopes to speak to students at theological colleges about the joys of bell ringing and will shortly publish a booklet for every vicar in the country entitled, "The Bells in Your Care. "Says Mr. Baldwin, "We recognize that we may <t>no</t> longer have as high a priority in church life and experience. "Mr. Baldwin is also attacking the greater problem: lack of ringers.

Senses:
1. definition=referring to the degree to which a certain quality is present | synonyms=no more | examples=he was no heavier than a child
2. definition=not in any degree or manner; not at all | examples=he is no better today
3. definition=used to express refusal or denial or disagreement etc or especially to emphasize a negative statement | examples=no, you are wrong

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    referring to the degree to which a certain quality is present

    no%4:02:02:: · no.r.01

    • he was no heavier than a child

    Synonyms: no more

    Selected
  2. 2

    not in any degree or manner; not at all

    no%4:02:01:: · no.r.02

    • he is no better today
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    used to express refusal or denial or disagreement etc or especially to emphasize a negative statement

    no%4:02:00:: · no.r.03

    • no, you are wrong

right Adv

Instance: senseval2.d000.s056.t000 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Says Mr. Baldwin, "We recognize that we may no longer have as high a priority in church life and experience. "

Mr. Baldwin is also attacking the greater problem: lack of ringers.

One survey says that of the 100,000 trained bellringers in England today, only 40,000 of them still ring.

Also, ringers do not always live where the bells need to be rung -- like in small, rural parishes and inner-city churches.

But the council's program to attract and train ringers is only partly successful, says Mr. Baldwin.

"Right now, we're lucky if after five years we keep one new ringer out of 10, "he adds.

One bright sign is that a growing number of women have entered the once male-dominated field; more than a third of the ringers today are women.

Show raw prompt

user

Which numbered sense of "right" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: Says Mr. Baldwin, "We recognize that we may no longer have as high a priority in church life and experience. "Mr. Baldwin is also attacking the greater problem: lack of ringers. One survey says that of the 100,000 trained bellringers in England today, only 40,000 of them still ring. Also, ringers do not always live where the bells need to be rung -- like in small, rural parishes and inner-city churches. But the council's program to attract and train ringers is only partly successful, says Mr. Baldwin. "<t>Right</t> now, we're lucky if after five years we keep one new ringer out of 10, "he adds. One bright sign is that a growing number of women have entered the once male-dominated field; more than a third of the ringers today are women.

Senses:
1. definition=precisely, exactly | examples=stand right here!
2. definition=immediately | examples=she called right after dinner
3. definition=exactly | synonyms=flop | examples=he fell flop on his face
4. definition=toward or on the right; also used figuratively | examples=he looked right and left; the party has moved right
5. definition=in the right manner | synonyms=properly, decently, decent, in good order, the right way | examples=please do your job properly!; can't you carry me decent?
6. definition=an interjection expressing agreement | synonyms=right on
7. definition=completely | examples=she felt right at home; he fell right into the trap
8. definition=(Southern regional intensive) very; to a great degree | synonyms=mighty, mightily, powerful | examples=the baby is mighty cute; he's mighty tired
9. definition=in accordance with moral or social standards | synonyms=justly | examples=that serves him right; do right by him
10. definition=in an accurate manner | synonyms=correctly, aright | examples=the flower had been correctly depicted by his son; he guessed right

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    precisely, exactly

    right%4:02:04:: · right.r.01

    • stand right here!
    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    immediately

    right%4:02:08:: · right.r.02

    • she called right after dinner
    Selected
  3. 3

    exactly

    right%4:02:09:: · right.r.03

    • he fell flop on his face

    Synonyms: flop

  4. 4

    toward or on the right; also used figuratively

    right%4:02:03:: · right.r.04

    • he looked right and left
    • the party has moved right
  5. 5

    in the right manner

    right%4:02:01:: · properly.r.01

    • please do your job properly!
    • can't you carry me decent?

    Synonyms: properly, decently, decent, in good order, the right way

  6. 6

    an interjection expressing agreement

    right%4:02:00:: · right.r.06

    Synonyms: right on

  7. 7

    completely

    right%4:02:07:: · right.r.07

    • she felt right at home
    • he fell right into the trap
  8. 8

    (Southern regional intensive) very; to a great degree

    right%4:02:06:: · mighty.r.01

    • the baby is mighty cute
    • he's mighty tired

    Synonyms: mighty, mightily, powerful

  9. 9

    in accordance with moral or social standards

    right%4:02:05:: · justly.r.02

    • that serves him right
    • do right by him

    Synonyms: justly

  10. 10

    in an accurate manner

    right%4:02:02:: · correctly.r.01

    • the flower had been correctly depicted by his son
    • he guessed right

    Synonyms: correctly, aright

simply Adv

Instance: senseval2.d001.s008.t005 Dataset: senseval2 Bucket: POS / ADV

Incorrect

That is for the future.

Already, scientists are developing tests based on the newly identified genes that, for the first time, can predict whether an otherwise healthy individual is likely to get cancer.

"It's a super-exciting set of discoveries, "says Bert Vogelstein, a Johns Hopkins University researcher who has just found a gene pivotal to the triggering of colon cancer.

"Only a decade ago cancer was a black box about which we knew nothing at the molecular level.

Today, we know that the accumulation of several of these altered genes can initiate a cancer and, then, propel it into a deadly state. "

Scientists call the new class of genes tumor-suppressors, or simply anti-cancer genes.

When functioning normally, they make proteins that hold a cell's growth in check.

Show raw prompt

user

Which numbered sense of "simply" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: That is for the future. Already, scientists are developing tests based on the newly identified genes that, for the first time, can predict whether an otherwise healthy individual is likely to get cancer. "It's a super-exciting set of discoveries, "says Bert Vogelstein, a Johns Hopkins University researcher who has just found a gene pivotal to the triggering of colon cancer. "Only a decade ago cancer was a black box about which we knew nothing at the molecular level. Today, we know that the accumulation of several of these altered genes can initiate a cancer and, then, propel it into a deadly state. "Scientists call the new class of genes tumor-suppressors, or <t>simply</t> anti-cancer genes. When functioning normally, they make proteins that hold a cell's growth in check.

Senses:
1. definition=and nothing more | synonyms=merely, just, only, but | examples=I was merely asking; it is simply a matter of time
2. definition=absolutely | synonyms=just | examples=I just can't take it anymore; he was just grand as Romeo
3. definition=absolutely; altogether; really | examples=we are simply broke
4. definition=in a simple manner; without extravagance or embellishment | synonyms=plainly | examples=she was dressed plainly; they lived very simply

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    and nothing more

    simply%4:02:00:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, just, only, but

    Gold Raganato Selected
  2. 2

    absolutely

    simply%4:02:03:: · just.r.04

    • I just can't take it anymore
    • he was just grand as Romeo

    Synonyms: just

  3. 3

    absolutely; altogether; really

    simply%4:02:02:: · simply.r.03

    • we are simply broke
  4. 4

    in a simple manner; without extravagance or embellishment

    simply%4:02:01:: · plainly.r.02

    • she was dressed plainly
    • they lived very simply

    Synonyms: plainly

    Gold lexEN Gold Maru 2022 Gold Raganato