Verified run

claude-haiku-5-5

claude-haiku-5.5-high-reasoning-p004-lexen-v1-20261009

Rank
90
Accuracy lexEN v1 · WordNet fine
92.06%
Correct
4475 / 4861
Actual run cost
$0.753
Cost / M items
$155

Accuracy across label schemes

The headline accuracy is lexEN v1 · WordNet fine-grained. Each cell re-scores this run's predictions against a different gold label set and sense granularity; coarse counts a prediction correct when its WordNet sense maps to the same Glite or CSI concept as a gold sense. About these label schemes → About coarsening →

Score against WordNet fine-grainedGlite coarse-grainedCSI coarse-grained (Lacerra 2020)
lexEN v1 92.06% 4475 / 4861 97.18% 4724 / 4861 95.04% 4620 / 4861
Maru 2022 (ALLamended) 89.06% 4329 / 4861 96.01% 4667 / 4861 93.07% 4524 / 4861
Raganato 2017 (original) 83.34% 4051 / 4861 93.56% 4548 / 4861 89.34% 4343 / 4861

Model

Display
claude-haiku-5-5
Requested
claude-haiku-5-5
Resolved
claude-haiku-5-5
Vendor
Anthropic
API provider
Anthropic
Hosting
cloud_api
Source
proprietary
License
n/a
Reasoning
high
Model URL
n/a
Endpoint
n/a
Resolved counts
claude-haiku-5-5: 4861

Reproducibility

Created
2026-10-09T12:48:44.543270+00:00
Run schema
sensebench-run-v2
Commit
9040664a78ce4afacbe5400eaf6538ee664f3dea
Dataset ID
lexen
Dataset version
lexen-v1
Dataset revision
n/a
Dataset items
4,861
Dataset hash
sha256:5fd4382b93f19087a1e31f6dd7d1db17c1eb17ff80fcbe1d3fdd55c0c3ecefe8
Prompt
p004
Prompt version
0.1.0
Repository files
Browse in GitHub

Runtime

Calls
4861
Total tokens
5,039,591
Tokens / item
1,036.7
Total cost
$0.753
Cost / M items
$155
Cost source
litellm_estimate
Elapsed
1.84m
Success items
4,861
Monosemous
0
No candidates
0
No valid vote
0
Invalid votes
0
Transport errors
0

Runner

GitHub
vassiliphilippov
Name
Vassili Philippov
Contact
n/a

Sampling

Temperature
n/a
Top P
n/a
Max tokens
32,768
Seed
n/a
Extra
n/a

Policy

Votes / item
1
Reasks / invalid vote
1
Tie break
earliest_vote
Monosemous
short_circuit

Cost And Token Breakdown

Actual recorded run cost: $0.753. Cost estimate source: litellm_estimate.

Token Type Tokens Cost Price / 1M tokens
Input uncached 4,417,330 $0.442 $0.100
Input cached 0 $0.00 $0.0100
Output 622,261 $0.311 $0.500
Reasoning output 0 included in output cost n/a

Reasoning output tokens are shown separately when the provider reports them; recorded cost is stored in the output cost bucket.

Download Raw Run Files

Slice Breakdown

Group Bucket Accuracy Correct Items
Candidate Count 11+ 90.18% 716 794
Candidate Count 2 96.14% 822 855
Candidate Count 3-5 92.29% 1795 1945
Candidate Count 6-10 90.13% 1142 1267
POS ADJ 92.56% 610 659
POS ADV 88.72% 173 195
POS NOUN 93.34% 2704 2897
POS VERB 89.01% 988 1110
Source Dataset semeval2013 95.44% 1088 1140
Source Dataset semeval2015 92.02% 680 739
Source Dataset senseval2 90.91% 1481 1629
Source Dataset senseval3 90.61% 1226 1353

Worst-Bucket Examples

now Adv

Instance: senseval2.d000.s008.t000 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong.

The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have.

In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614.

But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening.

Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service.

Now, only one local ringer remains: 64-year-old Derek Hammond.

The others here today live elsewhere.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: now
Target surface form: Now
Context:
Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong. The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have. In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614. But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening. Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service. <t>Now</t>, only one local ringer remains: 64-year-old Derek Hammond. The others here today live elsewhere.

Candidate senses:
1. sense_key=now%4:02:00:: | definition=in these times; - Nancy Mitford | synonyms=nowadays, today | examples=it is solely by their language that the upper classes nowadays are distinguished; we now rarely see horse-drawn vehicles on city streets
2. sense_key=now%4:02:06:: | definition=in the immediate past | examples=told me just now
3. sense_key=now%4:02:07:: | definition=(prefatory or transitional) indicates a change of subject or activity | examples=Now the next problem is...
4. sense_key=now%4:02:04:: | definition=at the present moment | synonyms=at present | examples=goods now on sale; the now-aging dictator
5. sense_key=now%4:02:05:: | definition=in the historical present; at this point in the narration of a series of past events | examples=President Kennedy now calls in the National Guard; Washington now decides to cross the Delaware
6. sense_key=now%4:02:01:: | definition=without delay or hesitation; with no time intervening | synonyms=immediately, instantly, straightaway, straight off, directly, right away | examples=he answered immediately; found an answer straightaway
7. sense_key=now%4:02:02:: | definition=used to preface a command or reproof or request | examples=now hear this!; now pay attention

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✓

WordNet 3.0 senses

  1. 1

    in these times; - Nancy Mitford

    now%4:02:00:: · nowadays.r.01

    • it is solely by their language that the upper classes nowadays are distinguished
    • we now rarely see horse-drawn vehicles on city streets

    Synonyms: nowadays, today

    Gold Raganato Selected
  2. 2

    in the immediate past

    now%4:02:06:: · now.r.07

    • told me just now
  3. 3

    (prefatory or transitional) indicates a change of subject or activity

    now%4:02:07:: · now.r.06

    • Now the next problem is...
  4. 4

    at the present moment

    now%4:02:04:: · now.r.04

    • goods now on sale
    • the now-aging dictator

    Synonyms: at present

    Gold lexEN Gold Maru 2022
  5. 5

    in the historical present; at this point in the narration of a series of past events

    now%4:02:05:: · now.r.01

    • President Kennedy now calls in the National Guard
    • Washington now decides to cross the Delaware
  6. 6

    without delay or hesitation; with no time intervening

    now%4:02:01:: · immediately.r.01

    • he answered immediately
    • found an answer straightaway

    Synonyms: immediately, instantly, straightaway, straight off, directly, right away, at once, forthwith, like a shot

  7. 7

    used to preface a command or reproof or request

    now%4:02:02:: · now.r.03

    • now hear this!
    • now pay attention

only Adv

Instance: senseval2.d000.s008.t001 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong.

The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have.

In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614.

But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening.

Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service.

Now, only one local ringer remains: 64-year-old Derek Hammond.

The others here today live elsewhere.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: only
Target surface form: only
Context:
Of all scenes that evoke rural England, this is one of the loveliest: An ancient stone church stands amid the fields, the sound of bells cascading from its tower, calling the faithful to evensong. The parishioners of St. Michael and All Angels stop to chat at the church door, as members here always have. In the tower, five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614. But there is also a discordant, modern note in Aslacton, though it can not be heard by the church-goers enjoying the peal of bells this cool autumn evening. Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service. Now, <t>only</t> one local ringer remains: 64-year-old Derek Hammond. The others here today live elsewhere.

Candidate senses:
1. sense_key=only%4:02:00:: | definition=with nevertheless the final result | examples=He arrived only to find his wife dead; We won only to lose again in the next round
2. sense_key=only%4:02:06:: | definition=except that | examples=It was the same story; only this time she came out better
3. sense_key=only%4:02:01:: | definition=without any others being included or involved | synonyms=entirely, exclusively, solely, alone | examples=was entirely to blame; a school devoted entirely to the needs of problem children
4. sense_key=only%4:02:04:: | definition=in the final outcome | examples=These news will only make you more upset
5. sense_key=only%4:02:05:: | definition=as recently as | examples=I spoke to him only an hour ago
6. sense_key=only%4:02:02:: | definition=and nothing more | synonyms=merely, simply, just, but | examples=I was merely asking; it is simply a matter of time
7. sense_key=only%4:02:03:: | definition=never except when | synonyms=only if, only when | examples=call me only if your cold gets worse

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    with nevertheless the final result

    only%4:02:00:: · only.r.03

    • He arrived only to find his wife dead
    • We won only to lose again in the next round
  2. 2

    except that

    only%4:02:06:: · only.r.05

    • It was the same story; only this time she came out better
  3. 3

    without any others being included or involved

    only%4:02:01:: · entirely.r.02

    • was entirely to blame
    • a school devoted entirely to the needs of problem children

    Synonyms: entirely, exclusively, solely, alone

    Selected
  4. 4

    in the final outcome

    only%4:02:04:: · only.r.04

    • These news will only make you more upset
  5. 5

    as recently as

    only%4:02:05:: · only.r.07

    • I spoke to him only an hour ago
  6. 6

    and nothing more

    only%4:02:02:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, just, but

    Gold lexEN Gold Maru 2022 Gold Raganato
  7. 7

    never except when

    only%4:02:03:: · only.r.06

    • call me only if your cold gets worse

    Synonyms: only if, only when

just Adv

Instance: senseval2.d000.s012.t005 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service.

Now, only one local ringer remains: 64-year-old Derek Hammond.

The others here today live elsewhere.

They belong to a group of 15 ringers -- including two octogenarians and four youngsters in training -- who drive every Sunday from church to church in a sometimes-exhausting effort to keep the bells sounding in the many belfries of East Anglia.

"To ring for even one service at this tower, we have to scrape, "says Mr. Hammond, a retired water-authority worker. "

We've tried to train the youngsters, but they have their discos and their dances, and they just drift away. "

Mr. Hammond worries that old age and the flightiness of youth will diminish the ranks of the East Anglian group that keeps the Aslacton bells pealing.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: just
Target surface form: just
Context:
Like most of the other 6,000 churches in Britain with sets of bells, St. Michael once had its own "band "of ringers, who would herald every Sunday morning and evening service. Now, only one local ringer remains: 64-year-old Derek Hammond. The others here today live elsewhere. They belong to a group of 15 ringers -- including two octogenarians and four youngsters in training -- who drive every Sunday from church to church in a sometimes-exhausting effort to keep the bells sounding in the many belfries of East Anglia. "To ring for even one service at this tower, we have to scrape, "says Mr. Hammond, a retired water-authority worker. "We've tried to train the youngsters, but they have their discos and their dances, and they <t>just</t> drift away. "Mr. Hammond worries that old age and the flightiness of youth will diminish the ranks of the East Anglian group that keeps the Aslacton bells pealing.

Candidate senses:
1. sense_key=just%4:02:01:: | definition=only a moment ago | synonyms=just now | examples=he has just arrived; the sun just now came out
2. sense_key=just%4:02:06:: | definition=exactly at this moment or the moment described | examples=we've just finished painting the walls, so don't touch them
3. sense_key=just%4:02:00:: | definition=and nothing more | synonyms=merely, simply, only, but | examples=I was merely asking; it is simply a matter of time
4. sense_key=just%4:02:03:: | definition=absolutely | synonyms=simply | examples=I just can't take it anymore; he was just grand as Romeo
5. sense_key=just%4:02:04:: | definition=only a very short time before; ; ; ; ; - W.B.Yeats | synonyms=barely, hardly, scarcely, scarce | examples=they could barely hear the speaker; we hardly knew them
6. sense_key=just%4:02:05:: | definition=indicating exactness or preciseness | synonyms=precisely, exactly | examples=he was doing precisely (or exactly) what she had told him to do; it was just as he said--the jewel was gone

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    only a moment ago

    just%4:02:01:: · just.r.03

    • he has just arrived
    • the sun just now came out

    Synonyms: just now

  2. 2

    exactly at this moment or the moment described

    just%4:02:06:: · just.r.06

    • we've just finished painting the walls, so don't touch them
  3. 3

    and nothing more

    just%4:02:00:: · merely.r.01

    • I was merely asking
    • it is simply a matter of time

    Synonyms: merely, simply, only, but

    Selected
  4. 4

    absolutely

    just%4:02:03:: · just.r.04

    • I just can't take it anymore
    • he was just grand as Romeo

    Synonyms: simply

    Gold lexEN Gold Maru 2022 Gold Raganato
  5. 5

    only a very short time before; ; ; ; ; - W.B.Yeats

    just%4:02:04:: · barely.r.01

    • they could barely hear the speaker
    • we hardly knew them

    Synonyms: barely, hardly, scarcely, scarce

  6. 6

    indicating exactness or preciseness

    just%4:02:05:: · precisely.r.01

    • he was doing precisely (or exactly) what she had told him to do
    • it was just as he said--the jewel was gone

    Synonyms: precisely, exactly

no Adv

Instance: senseval2.d000.s015.t009 Dataset: senseval2 Bucket: POS / ADV

Incorrect

They belong to a group of 15 ringers -- including two octogenarians and four youngsters in training -- who drive every Sunday from church to church in a sometimes-exhausting effort to keep the bells sounding in the many belfries of East Anglia.

"To ring for even one service at this tower, we have to scrape, "says Mr. Hammond, a retired water-authority worker. "

We've tried to train the youngsters, but they have their discos and their dances, and they just drift away. "

Mr. Hammond worries that old age and the flightiness of youth will diminish the ranks of the East Anglian group that keeps the Aslacton bells pealing.

History, after all, is not on his side.

According to a nationwide survey taken a year ago, nearly a third of England's church bells are no longer rung on Sundays because there is no one to ring them.

It is easy to see why the ancient art is on the ropes.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: no
Target surface form: no
Context:
They belong to a group of 15 ringers -- including two octogenarians and four youngsters in training -- who drive every Sunday from church to church in a sometimes-exhausting effort to keep the bells sounding in the many belfries of East Anglia. "To ring for even one service at this tower, we have to scrape, "says Mr. Hammond, a retired water-authority worker. "We've tried to train the youngsters, but they have their discos and their dances, and they just drift away. "Mr. Hammond worries that old age and the flightiness of youth will diminish the ranks of the East Anglian group that keeps the Aslacton bells pealing. History, after all, is not on his side. According to a nationwide survey taken a year ago, nearly a third of England's church bells are <t>no</t> longer rung on Sundays because there is no one to ring them. It is easy to see why the ancient art is on the ropes.

Candidate senses:
1. sense_key=no%4:02:02:: | definition=referring to the degree to which a certain quality is present | synonyms=no more | examples=he was no heavier than a child
2. sense_key=no%4:02:01:: | definition=not in any degree or manner; not at all | examples=he is no better today
3. sense_key=no%4:02:00:: | definition=used to express refusal or denial or disagreement etc or especially to emphasize a negative statement | examples=no, you are wrong

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    referring to the degree to which a certain quality is present

    no%4:02:02:: · no.r.01

    • he was no heavier than a child

    Synonyms: no more

    Selected
  2. 2

    not in any degree or manner; not at all

    no%4:02:01:: · no.r.02

    • he is no better today
    Gold lexEN Gold Maru 2022 Gold Raganato
  3. 3

    used to express refusal or denial or disagreement etc or especially to emphasize a negative statement

    no%4:02:00:: · no.r.03

    • no, you are wrong

straight Adv

Instance: senseval2.d000.s027.t004 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Ringers memorize patterns of changes, known as "methods, "which have odd-sounding names like Kent Treble Bob Major or Grandsire Caters.

A series of 5,000 or so changes is a "peal "and takes about three hours.

A look at a Thursday night practice at St. Mary Abbot church in the Kensington district of London gives an idea of the work involved.

Ten shirt-sleeved ringers stand in a circle, one foot ahead of the other in a prize-fighter's stance, each pulling a rope that disappears through a small hole in the high ceiling of the ringing chamber.

No one speaks, and the snaking of the ropes seems to make as much sound as the bells themselves, muffled by the ceiling.

Totally absorbed, the ringers stare straight ahead, using peripheral vision (they call it "rope-sight ") to watch the other ropes and thus time their pulls.

Far above in the belfry, the huge bronze bells, mounted on wheels, swing madly through a full 360 degrees, starting and ending, surprisingly, in the inverted, or mouth-up position.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: straight
Target surface form: straight
Context:
Ringers memorize patterns of changes, known as "methods, "which have odd-sounding names like Kent Treble Bob Major or Grandsire Caters. A series of 5,000 or so changes is a "peal "and takes about three hours. A look at a Thursday night practice at St. Mary Abbot church in the Kensington district of London gives an idea of the work involved. Ten shirt-sleeved ringers stand in a circle, one foot ahead of the other in a prize-fighter's stance, each pulling a rope that disappears through a small hole in the high ceiling of the ringing chamber. No one speaks, and the snaking of the ropes seems to make as much sound as the bells themselves, muffled by the ceiling. Totally absorbed, the ringers stare <t>straight</t> ahead, using peripheral vision (they call it "rope-sight ") to watch the other ropes and thus time their pulls. Far above in the belfry, the huge bronze bells, mounted on wheels, swing madly through a full 360 degrees, starting and ending, surprisingly, in the inverted, or mouth-up position.

Candidate senses:
1. sense_key=straight%4:02:00:: | definition=in a straight line; in a direct course | examples=the road runs straight
2. sense_key=straight%4:02:04:: | definition=in a forthright manner; candidly or frankly | synonyms=directly, flat | examples=he didn't answer directly; told me straight out
3. sense_key=straight%4:02:05:: | definition=without deviation | synonyms=directly, direct | examples=the path leads directly to the lake; went direct to the office

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✓ Raganato ✗

WordNet 3.0 senses

  1. 1

    in a straight line; in a direct course

    straight%4:02:00:: · straight.r.03

    • the road runs straight
    Gold Maru 2022 Selected
  2. 2

    in a forthright manner; candidly or frankly

    straight%4:02:04:: · directly.r.04

    • he didn't answer directly
    • told me straight out

    Synonyms: directly, flat

  3. 3

    without deviation

    straight%4:02:05:: · directly.r.01

    • the path leads directly to the lake
    • went direct to the office

    Synonyms: directly, direct

    Gold lexEN Gold Raganato

thus Adv

Instance: senseval2.d000.s027.t012 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Ringers memorize patterns of changes, known as "methods, "which have odd-sounding names like Kent Treble Bob Major or Grandsire Caters.

A series of 5,000 or so changes is a "peal "and takes about three hours.

A look at a Thursday night practice at St. Mary Abbot church in the Kensington district of London gives an idea of the work involved.

Ten shirt-sleeved ringers stand in a circle, one foot ahead of the other in a prize-fighter's stance, each pulling a rope that disappears through a small hole in the high ceiling of the ringing chamber.

No one speaks, and the snaking of the ropes seems to make as much sound as the bells themselves, muffled by the ceiling.

Totally absorbed, the ringers stare straight ahead, using peripheral vision (they call it "rope-sight ") to watch the other ropes and thus time their pulls.

Far above in the belfry, the huge bronze bells, mounted on wheels, swing madly through a full 360 degrees, starting and ending, surprisingly, in the inverted, or mouth-up position.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: thus
Target surface form: thus
Context:
Ringers memorize patterns of changes, known as "methods, "which have odd-sounding names like Kent Treble Bob Major or Grandsire Caters. A series of 5,000 or so changes is a "peal "and takes about three hours. A look at a Thursday night practice at St. Mary Abbot church in the Kensington district of London gives an idea of the work involved. Ten shirt-sleeved ringers stand in a circle, one foot ahead of the other in a prize-fighter's stance, each pulling a rope that disappears through a small hole in the high ceiling of the ringing chamber. No one speaks, and the snaking of the ropes seems to make as much sound as the bells themselves, muffled by the ceiling. Totally absorbed, the ringers stare straight ahead, using peripheral vision (they call it "rope-sight ") to watch the other ropes and <t>thus</t> time their pulls. Far above in the belfry, the huge bronze bells, mounted on wheels, swing madly through a full 360 degrees, starting and ending, surprisingly, in the inverted, or mouth-up position.

Candidate senses:
1. sense_key=thus%4:02:00:: | definition=(used to introduce a logical conclusion) from that fact or reason or as a result | synonyms=therefore, hence, thence, so | examples=therefore X must be true; the eggs were fresh and hence satisfactory
2. sense_key=thus%4:02:01:: | definition=in the way indicated; ; ; (`thusly' is a nonstandard variant) | synonyms=thusly, so | examples=hold the brush so; set up the pieces thus

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    (used to introduce a logical conclusion) from that fact or reason or as a result

    thus%4:02:00:: · therefore.r.01

    • therefore X must be true
    • the eggs were fresh and hence satisfactory

    Synonyms: therefore, hence, thence, so

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    in the way indicated; ; ; (`thusly' is a nonstandard variant)

    thus%4:02:01:: · thus.r.02

    • hold the brush so
    • set up the pieces thus

    Synonyms: thusly, so

    Selected

however Adv

Instance: senseval2.d000.s033.t004 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Far above in the belfry, the huge bronze bells, mounted on wheels, swing madly through a full 360 degrees, starting and ending, surprisingly, in the inverted, or mouth-up position.

Skilled ringers use their wrists to advance or retard the next swing, so that one bell can swap places with another in the following change.

In a well-known detective-story involving church bells, English novelist Dorothy L. Sayers described ringing as a "passion that finds its satisfaction in mathematical completeness and mechanical perfection. "

Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""

Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers.

It is a passion that usually stays in the tower, however.

More often than not, ringers think of the church as something stuck on the bottom of the belfry.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: however
Target surface form: however
Context:
Far above in the belfry, the huge bronze bells, mounted on wheels, swing madly through a full 360 degrees, starting and ending, surprisingly, in the inverted, or mouth-up position. Skilled ringers use their wrists to advance or retard the next swing, so that one bell can swap places with another in the following change. In a well-known detective-story involving church bells, English novelist Dorothy L. Sayers described ringing as a "passion that finds its satisfaction in mathematical completeness and mechanical perfection. "Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers. It is a passion that usually stays in the tower, <t>however</t>. More often than not, ringers think of the church as something stuck on the bottom of the belfry.

Candidate senses:
1. sense_key=however%4:02:00:: | definition=despite anything to the contrary (usually following a concession) | synonyms=nevertheless, withal, still, yet, all the same, even so | examples=although I'm a little afraid, however I'd like to try it; while we disliked each other, nevertheless we agreed
2. sense_key=however%4:02:01:: | definition=in whatever way or manner | examples=Victory, however it was brought about, was sweet; however he did it, it was very clever
3. sense_key=however%4:02:04:: | definition=by contrast; on the other hand | examples=the first part was easy; the second, however, took hours
4. sense_key=however%4:02:02:: | definition=to whatever degree or extent | examples=The results, however general, are important; they have begun, however reluctantly, to acknowledge the legitimacy of some of the opposition's concerns

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    despite anything to the contrary (usually following a concession)

    however%4:02:00:: · however.r.01

    • although I'm a little afraid, however I'd like to try it
    • while we disliked each other, nevertheless we agreed

    Synonyms: nevertheless, withal, still, yet, all the same, even so, nonetheless, notwithstanding

    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    in whatever way or manner

    however%4:02:01:: · however.r.04

    • Victory, however it was brought about, was sweet
    • however he did it, it was very clever
  3. 3

    by contrast; on the other hand

    however%4:02:04:: · however.r.02

    • the first part was easy; the second, however, took hours
    Selected
  4. 4

    to whatever degree or extent

    however%4:02:02:: · however.r.03

    • The results, however general, are important
    • they have begun, however reluctantly, to acknowledge the legitimacy of some of the opposition's concerns

well Adv

Instance: senseval2.d000.s036.t000 Dataset: senseval2 Bucket: POS / ADV

Incorrect

Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""

Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers.

It is a passion that usually stays in the tower, however.

More often than not, ringers think of the church as something stuck on the bottom of the belfry.

When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below.

This does not sit well with some clerics.

With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: well
Target surface form: well
Context:
Ringers, she added, are "filled with the solemn intoxication that comes of intricate ritual faultlessly performed. ""Ringing does become a bit of an obsession, "admits Stephanie Pattenden, master of the band at St. Mary Abbot and one of England's best female ringers. It is a passion that usually stays in the tower, however. More often than not, ringers think of the church as something stuck on the bottom of the belfry. When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below. This does not sit <t>well</t> with some clerics. With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services.

Candidate senses:
1. sense_key=well%4:02:13:: | definition=with prudence or propriety | examples=You would do well to say nothing more; could not well refuse
2. sense_key=well%4:02:12:: | definition=with skill or in a pleasing manner | examples=she dances well; he writes well
3. sense_key=well%4:02:11:: | definition=to a great extent or degree | synonyms=considerably, substantially | examples=I'm afraid the film was well over budget; painting the room white made it seem considerably (or substantially) larger
4. sense_key=well%4:02:05:: | definition=thoroughly or completely; fully; often used as a combining form; ; ; ; ; , | examples=The problem is well understood; she was well informed
5. sense_key=well%4:02:10:: | definition=in a manner affording benefit or advantage | synonyms=advantageously | examples=she married well; The children were settled advantageously in Seattle
6. sense_key=well%4:02:08:: | definition=to a suitable or appropriate extent or degree | examples=the project was well underway; the fetus has well developed organs
7. sense_key=well%4:02:01:: | definition=without unusual distress or resentment; with good humor | examples=took the joke well; took the tragic news well
8. sense_key=well%4:02:00:: | definition=(often used as a combining form) in a good or proper or satisfactory manner or to a high standard (`good' is a nonstandard dialectal variant for `well') | synonyms=good | examples=the children behaved well; a task well done
9. sense_key=well%4:02:07:: | definition=favorably; with approval | examples=their neighbors spoke well of them; he thought well of the book
10. sense_key=well%4:02:09:: | definition=in financial comfort | synonyms=comfortably | examples=They live well; she has been able to live comfortably since her husband died
11. sense_key=well%4:02:15:: | definition=(used for emphasis or as an intensifier) entirely or fully | examples=a book well worth reading; was well aware of the difficulties ahead
12. sense_key=well%4:02:14:: | definition=with great or especially intimate knowledge | synonyms=intimately | examples=we knew them well
13. sense_key=well%4:02:03:: | definition=indicating high probability; in all likelihood | synonyms=easily | examples=I might well do it; a mistake that could easily have ended in disaster

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    with prudence or propriety

    well%4:02:13:: · well.r.09

    • You would do well to say nothing more
    • could not well refuse
  2. 2

    with skill or in a pleasing manner

    well%4:02:12:: · well.r.10

    • she dances well
    • he writes well
  3. 3

    to a great extent or degree

    well%4:02:11:: · well.r.07

    • I'm afraid the film was well over budget
    • painting the room white made it seem considerably (or substantially) larger

    Synonyms: considerably, substantially

  4. 4

    thoroughly or completely; fully; often used as a combining form; ; ; ; ; ,

    well%4:02:05:: · well.r.02

    • The problem is well understood
    • she was well informed
  5. 5

    in a manner affording benefit or advantage

    well%4:02:10:: · well.r.11

    • she married well
    • The children were settled advantageously in Seattle

    Synonyms: advantageously

  6. 6

    to a suitable or appropriate extent or degree

    well%4:02:08:: · well.r.05

    • the project was well underway
    • the fetus has well developed organs
  7. 7

    without unusual distress or resentment; with good humor

    well%4:02:01:: · well.r.13

    • took the joke well
    • took the tragic news well
  8. 8

    (often used as a combining form) in a good or proper or satisfactory manner or to a high standard (`good' is a nonstandard dialectal variant for `well')

    well%4:02:00:: · well.r.01

    • the children behaved well
    • a task well done

    Synonyms: good

    Gold lexEN Gold Maru 2022 Gold Raganato
  9. 9

    favorably; with approval

    well%4:02:07:: · well.r.06

    • their neighbors spoke well of them
    • he thought well of the book
    Selected
  10. 10

    in financial comfort

    well%4:02:09:: · well.r.12

    • They live well
    • she has been able to live comfortably since her husband died

    Synonyms: comfortably

  11. 11

    (used for emphasis or as an intensifier) entirely or fully

    well%4:02:15:: · well.r.04

    • a book well worth reading
    • was well aware of the difficulties ahead
  12. 12

    with great or especially intimate knowledge

    well%4:02:14:: · well.r.08

    • we knew them well

    Synonyms: intimately

  13. 13

    indicating high probability; in all likelihood

    well%4:02:03:: · well.r.03

    • I might well do it
    • a mistake that could easily have ended in disaster

    Synonyms: easily

so Adv

Instance: senseval2.d000.s038.t004 Dataset: senseval2 Bucket: POS / ADV

Incorrect

It is a passion that usually stays in the tower, however.

More often than not, ringers think of the church as something stuck on the bottom of the belfry.

When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below.

This does not sit well with some clerics.

With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services.

Two years ago, the Rev. Jeremy Hummerstone, vicar of Great Torrington, Devon, got so fed up with ringers who didn't attend service he sacked the entire band; the ringers promptly set up a picket line in protest.

"They were a self-perpetuating club that treated the tower as sort of a separate premises, "the Vicar Hummerstone says.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: so
Target surface form: so
Context:
It is a passion that usually stays in the tower, however. More often than not, ringers think of the church as something stuck on the bottom of the belfry. When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below. This does not sit well with some clerics. With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services. Two years ago, the Rev. Jeremy Hummerstone, vicar of Great Torrington, Devon, got <t>so</t> fed up with ringers who didn't attend service he sacked the entire band; the ringers promptly set up a picket line in protest. "They were a self-perpetuating club that treated the tower as sort of a separate premises, "the Vicar Hummerstone says.

Candidate senses:
1. sense_key=so%4:02:09:: | definition=subsequently or soon afterward (often used as sentence connectors) | synonyms=then, and so, and then | examples=then he left; go left first, then right
2. sense_key=so%4:02:10:: | definition=(used to introduce a logical conclusion) from that fact or reason or as a result | synonyms=therefore, hence, thence, thus | examples=therefore X must be true; the eggs were fresh and hence satisfactory
3. sense_key=so%4:02:05:: | definition=in such a condition or manner, especially as expressed or implied | examples=They're happy and I hope they will remain so; so live your life that old age will bring no regrets
4. sense_key=so%4:02:02:: | definition=to a very great extent or degree | examples=the idea is so obvious; never been so happy
5. sense_key=so%4:02:07:: | definition=to a certain unspecified extent or degree | examples=I can only go so far with this student; can do only so much in a day
6. sense_key=so%4:02:00:: | definition=in truth (often tends to intensify) | synonyms=indeed | examples=they said the car would break down and indeed it did; it is very cold indeed
7. sense_key=so%4:02:04:: | definition=in the way indicated; ; ; (`thusly' is a nonstandard variant) | synonyms=thus, thusly | examples=hold the brush so; set up the pieces thus
8. sense_key=so%4:02:08:: | definition=in the same way; also | examples=I was offended and so was he; worked hard and so did she
9. sense_key=so%4:02:06:: | definition=in a manner that facilitates | examples=he observed the snakes so he could describe their behavior; he stooped down so he could pick up his hat
10. sense_key=so%4:02:03:: | definition=(usually followed by `that') to an extent or degree as expressed | examples=he was so tired he could hardly stand; so dirty that it smells

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✓ Raganato ✓

WordNet 3.0 senses

  1. 1

    subsequently or soon afterward (often used as sentence connectors)

    so%4:02:09:: · then.r.01

    • then he left
    • go left first, then right

    Synonyms: then, and so, and then

  2. 2

    (used to introduce a logical conclusion) from that fact or reason or as a result

    so%4:02:10:: · therefore.r.01

    • therefore X must be true
    • the eggs were fresh and hence satisfactory

    Synonyms: therefore, hence, thence, thus

  3. 3

    in such a condition or manner, especially as expressed or implied

    so%4:02:05:: · so.r.03

    • They're happy and I hope they will remain so
    • so live your life that old age will bring no regrets
  4. 4

    to a very great extent or degree

    so%4:02:02:: · so.r.01

    • the idea is so obvious
    • never been so happy
    Gold Maru 2022 Gold Raganato Selected
  5. 5

    to a certain unspecified extent or degree

    so%4:02:07:: · so.r.04

    • I can only go so far with this student
    • can do only so much in a day
  6. 6

    in truth (often tends to intensify)

    so%4:02:00:: · indeed.r.01

    • they said the car would break down and indeed it did
    • it is very cold indeed

    Synonyms: indeed

  7. 7

    in the way indicated; ; ; (`thusly' is a nonstandard variant)

    so%4:02:04:: · thus.r.02

    • hold the brush so
    • set up the pieces thus

    Synonyms: thus, thusly

  8. 8

    in the same way; also

    so%4:02:08:: · so.r.05

    • I was offended and so was he
    • worked hard and so did she
  9. 9

    in a manner that facilitates

    so%4:02:06:: · so.r.02

    • he observed the snakes so he could describe their behavior
    • he stooped down so he could pick up his hat
  10. 10

    (usually followed by `that') to an extent or degree as expressed

    so%4:02:03:: · so.r.07

    • he was so tired he could hardly stand
    • so dirty that it smells
    Gold lexEN

promptly Adv

Instance: senseval2.d000.s038.t012 Dataset: senseval2 Bucket: POS / ADV

Incorrect

It is a passion that usually stays in the tower, however.

More often than not, ringers think of the church as something stuck on the bottom of the belfry.

When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below.

This does not sit well with some clerics.

With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services.

Two years ago, the Rev. Jeremy Hummerstone, vicar of Great Torrington, Devon, got so fed up with ringers who didn't attend service he sacked the entire band; the ringers promptly set up a picket line in protest.

"They were a self-perpetuating club that treated the tower as sort of a separate premises, "the Vicar Hummerstone says.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: promptly
Target surface form: promptly
Context:
It is a passion that usually stays in the tower, however. More often than not, ringers think of the church as something stuck on the bottom of the belfry. When their changes are completed, and after they have worked up a sweat, ringers often skip off to the local pub, leaving worship for others below. This does not sit well with some clerics. With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services. Two years ago, the Rev. Jeremy Hummerstone, vicar of Great Torrington, Devon, got so fed up with ringers who didn't attend service he sacked the entire band; the ringers <t>promptly</t> set up a picket line in protest. "They were a self-perpetuating club that treated the tower as sort of a separate premises, "the Vicar Hummerstone says.

Candidate senses:
1. sense_key=promptly%4:02:00:: | definition=in a punctual manner | synonyms=readily, pronto | examples=he did his homework promptly
2. sense_key=promptly%4:02:01:: | definition=at once (usually modifies an undesirable occurrence) | synonyms=right away | examples=he promptly forgot the address
3. sense_key=promptly%4:02:02:: | definition=with little or no delay | synonyms=quickly, quick | examples=the rescue squad arrived promptly; come here, quick!

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    in a punctual manner

    promptly%4:02:00:: · promptly.r.02

    • he did his homework promptly

    Synonyms: readily, pronto

  2. 2

    at once (usually modifies an undesirable occurrence)

    promptly%4:02:01:: · promptly.r.03

    • he promptly forgot the address

    Synonyms: right away

    Selected
  3. 3

    with little or no delay

    promptly%4:02:02:: · promptly.r.01

    • the rescue squad arrived promptly
    • come here, quick!

    Synonyms: quickly, quick

    Gold lexEN Gold Maru 2022 Gold Raganato

still Adv

Instance: senseval2.d000.s041.t000 Dataset: senseval2 Bucket: POS / ADV

Incorrect

This does not sit well with some clerics.

With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services.

Two years ago, the Rev. Jeremy Hummerstone, vicar of Great Torrington, Devon, got so fed up with ringers who didn't attend service he sacked the entire band; the ringers promptly set up a picket line in protest.

"They were a self-perpetuating club that treated the tower as sort of a separate premises, "the Vicar Hummerstone says.

An entirely new band rings today at Great Torrington, several of whom are members of the congregation.

But there still are not enough ringers to ring more than six of the eight bells.

At St. Mary's Church in Ilminster, Somerset, the bells have fallen silent following a dust-up over church attendance.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: still
Target surface form: still
Context:
This does not sit well with some clerics. With membership of the Church of England steadily dwindling, strong-willed vicars are pressing equally strong-willed and often non-religious ringers to attend services. Two years ago, the Rev. Jeremy Hummerstone, vicar of Great Torrington, Devon, got so fed up with ringers who didn't attend service he sacked the entire band; the ringers promptly set up a picket line in protest. "They were a self-perpetuating club that treated the tower as sort of a separate premises, "the Vicar Hummerstone says. An entirely new band rings today at Great Torrington, several of whom are members of the congregation. But there <t>still</t> are not enough ringers to ring more than six of the eight bells. At St. Mary's Church in Ilminster, Somerset, the bells have fallen silent following a dust-up over church attendance.

Candidate senses:
1. sense_key=still%4:02:01:: | definition=with reference to action or condition; without change, interruption, or cessation | examples=it's still warm outside; will you still love me when we're old and grey?
2. sense_key=still%4:02:04:: | definition=despite anything to the contrary (usually following a concession) | synonyms=however, nevertheless, withal, yet, all the same, even so | examples=although I'm a little afraid, however I'd like to try it; while we disliked each other, nevertheless we agreed
3. sense_key=still%4:02:02:: | definition=without moving or making a sound | synonyms=stock-still | examples=he sat still as a statue; time stood still
4. sense_key=still%4:02:00:: | definition=to a greater degree or extent; used with comparisons | synonyms=even, yet | examples=looked sick and felt even worse; an even (or still) more interesting problem

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    with reference to action or condition; without change, interruption, or cessation

    still%4:02:01:: · still.r.01

    • it's still warm outside
    • will you still love me when we're old and grey?
    Gold lexEN Gold Maru 2022 Gold Raganato
  2. 2

    despite anything to the contrary (usually following a concession)

    still%4:02:04:: · however.r.01

    • although I'm a little afraid, however I'd like to try it
    • while we disliked each other, nevertheless we agreed

    Synonyms: however, nevertheless, withal, yet, all the same, even so, nonetheless, notwithstanding

    Selected
  3. 3

    without moving or making a sound

    still%4:02:02:: · still.r.04

    • he sat still as a statue
    • time stood still

    Synonyms: stock-still

  4. 4

    to a greater degree or extent; used with comparisons

    still%4:02:00:: · even.r.03

    • looked sick and felt even worse
    • an even (or still) more interesting problem

    Synonyms: even, yet

so Adv

Instance: senseval2.d000.s045.t000 Dataset: senseval2 Bucket: POS / ADV

Incorrect

An entirely new band rings today at Great Torrington, several of whom are members of the congregation.

But there still are not enough ringers to ring more than six of the eight bells.

At St. Mary's Church in Ilminster, Somerset, the bells have fallen silent following a dust-up over church attendance.

The vicar, W.D. Jones, refuses to talk about it, saying it would "reopen the wound. "

But C.J.B. Marshall, vicar of a nearby church, feels the fault is in the stairs from the bell tower that are located next to the altar.

"So crunch, crunch, crunch, bang, bang, bang -- here come the ringers from above, making a very obvious exit while the congregation is at prayer, "he says.

Vicar Marshall admits to mixed feelings about this issue, since he is both a vicar and an active bell-ringer himself.

Show raw prompt

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: so
Target surface form: So
Context:
An entirely new band rings today at Great Torrington, several of whom are members of the congregation. But there still are not enough ringers to ring more than six of the eight bells. At St. Mary's Church in Ilminster, Somerset, the bells have fallen silent following a dust-up over church attendance. The vicar, W.D. Jones, refuses to talk about it, saying it would "reopen the wound. "But C.J.B. Marshall, vicar of a nearby church, feels the fault is in the stairs from the bell tower that are located next to the altar. "<t>So</t> crunch, crunch, crunch, bang, bang, bang -- here come the ringers from above, making a very obvious exit while the congregation is at prayer, "he says. Vicar Marshall admits to mixed feelings about this issue, since he is both a vicar and an active bell-ringer himself.

Candidate senses:
1. sense_key=so%4:02:00:: | definition=in truth (often tends to intensify) | synonyms=indeed | examples=they said the car would break down and indeed it did; it is very cold indeed
2. sense_key=so%4:02:04:: | definition=in the way indicated; ; ; (`thusly' is a nonstandard variant) | synonyms=thus, thusly | examples=hold the brush so; set up the pieces thus
3. sense_key=so%4:02:03:: | definition=(usually followed by `that') to an extent or degree as expressed | examples=he was so tired he could hardly stand; so dirty that it smells
4. sense_key=so%4:02:10:: | definition=(used to introduce a logical conclusion) from that fact or reason or as a result | synonyms=therefore, hence, thence, thus | examples=therefore X must be true; the eggs were fresh and hence satisfactory
5. sense_key=so%4:02:05:: | definition=in such a condition or manner, especially as expressed or implied | examples=They're happy and I hope they will remain so; so live your life that old age will bring no regrets
6. sense_key=so%4:02:06:: | definition=in a manner that facilitates | examples=he observed the snakes so he could describe their behavior; he stooped down so he could pick up his hat
7. sense_key=so%4:02:02:: | definition=to a very great extent or degree | examples=the idea is so obvious; never been so happy
8. sense_key=so%4:02:07:: | definition=to a certain unspecified extent or degree | examples=I can only go so far with this student; can do only so much in a day
9. sense_key=so%4:02:09:: | definition=subsequently or soon afterward (often used as sentence connectors) | synonyms=then, and so, and then | examples=then he left; go left first, then right
10. sense_key=so%4:02:08:: | definition=in the same way; also | examples=I was offended and so was he; worked hard and so did she

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Prediction matches gold: lexEN ✗ Maru 2022 ✗ Raganato ✗

WordNet 3.0 senses

  1. 1

    in truth (often tends to intensify)

    so%4:02:00:: · indeed.r.01

    • they said the car would break down and indeed it did
    • it is very cold indeed

    Synonyms: indeed

  2. 2

    in the way indicated; ; ; (`thusly' is a nonstandard variant)

    so%4:02:04:: · thus.r.02

    • hold the brush so
    • set up the pieces thus

    Synonyms: thus, thusly

    Selected
  3. 3

    (usually followed by `that') to an extent or degree as expressed

    so%4:02:03:: · so.r.07

    • he was so tired he could hardly stand
    • so dirty that it smells
  4. 4

    (used to introduce a logical conclusion) from that fact or reason or as a result

    so%4:02:10:: · therefore.r.01

    • therefore X must be true
    • the eggs were fresh and hence satisfactory

    Synonyms: therefore, hence, thence, thus

    Gold lexEN
  5. 5

    in such a condition or manner, especially as expressed or implied

    so%4:02:05:: · so.r.03

    • They're happy and I hope they will remain so
    • so live your life that old age will bring no regrets
  6. 6

    in a manner that facilitates

    so%4:02:06:: · so.r.02

    • he observed the snakes so he could describe their behavior
    • he stooped down so he could pick up his hat
  7. 7

    to a very great extent or degree

    so%4:02:02:: · so.r.01

    • the idea is so obvious
    • never been so happy
  8. 8

    to a certain unspecified extent or degree

    so%4:02:07:: · so.r.04

    • I can only go so far with this student
    • can do only so much in a day
  9. 9

    subsequently or soon afterward (often used as sentence connectors)

    so%4:02:09:: · then.r.01

    • then he left
    • go left first, then right

    Synonyms: then, and so, and then

    Gold Maru 2022 Gold Raganato
  10. 10

    in the same way; also

    so%4:02:08:: · so.r.05

    • I was offended and so was he
    • worked hard and so did she