Prompts

p004: 5+1 Context, Randomized WordNet Glosses

English fine-grained Word Sense Disambiguation prompt matching p001 except candidate senses are deterministically randomized per item instead of ordered by WordNet frequency. The target sentence uses 5 preceding and 1 following sentence of detokenized context, the target is marked with <t>...</t>, candidate senses include WordNet sense keys, definitions, synonyms, and usage examples, and the model returns JSON with sense_index.

⬇ Download p004.json

Prompt Metadata

ID
p004
Schema
sensebench-prompt-v1
Template
chat_messages
Output
json_sense_index
Supersedes
n/a

Rendering Parameters

{
  "previous_sentences": 5,
  "next_sentences": 1,
  "target_marker": "xml_t",
  "sense_order": "random_fixed",
  "candidate_format": "compact_labeled_inline",
  "include_wordnet_id": true,
  "wordnet_id_kind": "sense_key",
  "include_definition": true,
  "include_examples": true,
  "examples_max_per_sense": 2,
  "include_pos": false,
  "include_synonyms": true,
  "synonyms_max_per_sense": 6,
  "detokenize": true
}

Messages

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: {{target_lemma}}
Target surface form: {{target_text}}
Context:
{{context}}

Candidate senses:
{{candidate_senses}}

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

Rendered Item Examples

This prompt rendered against 3 sample items from the lexEN dataset — exactly the text sent to the model, with candidate senses, the context window, and the target marker filled in.

senseval2.d000.s000.t000 — “art”

lemma art · pos NOUN · 4 candidate senses

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: art
Target surface form: art
Context:
The <t>art</t> of change-ringing is peculiar to the English, and, like most English peculiarities, unintelligible to the rest of the world. Dorothy L. Sayers, "The Nine Tailors "

Candidate senses:
1. sense_key=art%1:04:00:: | definition=the creation of beautiful or significant things | synonyms=artistic creation, artistic production | examples=art does not need to be innovative to be good; I was never any good at art
2. sense_key=art%1:10:00:: | definition=photographs or other visual representations in a printed publication | synonyms=artwork, graphics, nontextual matter | examples=the publisher was responsible for all the artwork in the book
3. sense_key=art%1:09:00:: | definition=a superior skill that you can learn by study and practice and observation | synonyms=artistry, prowess | examples=the art of conversation; it's quite an art
4. sense_key=art%1:06:00:: | definition=the products of human creativity; works of art collectively | synonyms=fine art | examples=an art exhibition; a fine collection of art

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

senseval2.d000.s000.t002 — “peculiar”

lemma peculiar · pos ADJ · 4 candidate senses

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: peculiar
Target surface form: peculiar
Context:
The art of change-ringing is <t>peculiar</t> to the English, and, like most English peculiarities, unintelligible to the rest of the world. Dorothy L. Sayers, "The Nine Tailors "

Candidate senses:
1. sense_key=peculiar%5:00:00:strange:00 | definition=beyond or deviating from the usual or expected | synonyms=curious, funny, odd, queer, rum, rummy | examples=a curious hybrid accent; her speech has a funny twang
2. sense_key=peculiar%5:00:00:characteristic:00 | definition=characteristic of one only; distinctive or special; - R.B.Taney | examples=the peculiar character of the Government of the U.S.
3. sense_key=peculiar%5:00:00:specific:00 | definition=unique or specific to a person or thing or category | synonyms=particular, special | examples=the particular demands of the job; has a particular preference for Chinese art
4. sense_key=peculiar%5:00:00:unusual:00 | definition=markedly different from the usual; ; -Virginia Woolf | examples=a peculiar hobby of stuffing and mounting bats; a man...feels it a peculiar insult to be taunted with cowardice by a woman

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.

senseval2.d000.s000.t003 — “English”

lemma english · pos NOUN · 4 candidate senses

system

You are an English linguist performing fine-grained Word Sense Disambiguation. WordNet glosses are schematic. Use the sentence context, the examples, and the synonyms to choose the best indexed sense. Do not hedge. Choose the single best indexed sense.

user

Target lemma: english
Target surface form: English
Context:
The art of change-ringing is peculiar to the <t>English</t>, and, like most English peculiarities, unintelligible to the rest of the world. Dorothy L. Sayers, "The Nine Tailors "

Candidate senses:
1. sense_key=english%1:18:00:: | definition=the people of England | synonyms=English people
2. sense_key=english%1:09:00:: | definition=the discipline that studies the English language and literature
3. sense_key=english%1:11:00:: | definition=(sports) the spin given to a ball by striking it on one side or releasing it with a sharp twist | synonyms=side
4. sense_key=english%1:10:00:: | definition=an Indo-European language belonging to the West Germanic branch; the official language of Britain and the United States and most of the commonwealth countries | synonyms=English language

Instructions:
1. Choose the single best indexed sense for the target word in context.
2. WordNet glosses are schematic; use the context, synonyms, and examples together.
3. Do not answer with a WordNet sense key.
4. Return only a JSON object exactly like {"sense_index": 3}.