Prompts

p003: p002 + 5+1 Context + Synonyms + Two Examples

Workhorse English Word Sense Disambiguation prompt selected from the p021 ablation candidate: based on p002 with the p001 context window, synonyms, and a second candidate example per sense added while keeping no target metadata, no WordNet sense keys, and plain-number output.

⬇ Download p003.json

Prompt Metadata

ID
p003
Schema
sensebench-prompt-v1
Template
chat_messages
Output
plain_sense_index
Supersedes
n/a

Rendering Parameters

{
  "previous_sentences": 5,
  "next_sentences": 1,
  "target_marker": "xml_t",
  "sense_order": "frequency",
  "candidate_format": "compact_labeled_inline",
  "include_wordnet_id": false,
  "wordnet_id_kind": "none",
  "include_definition": true,
  "include_examples": true,
  "examples_max_per_sense": 2,
  "include_pos": false,
  "include_synonyms": true,
  "synonyms_max_per_sense": 6,
  "detokenize": true
}

Messages

user

Which numbered sense of "{{target_lemma}}" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: {{context}}

Senses:
{{candidate_senses}}

Rendered Item Examples

This prompt rendered against 3 sample items from the lexEN dataset — exactly the text sent to the model, with candidate senses, the context window, and the target marker filled in.

senseval2.d000.s000.t000 — “art”

lemma art · pos NOUN · 4 candidate senses

user

Which numbered sense of "art" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: The <t>art</t> of change-ringing is peculiar to the English, and, like most English peculiarities, unintelligible to the rest of the world. Dorothy L. Sayers, "The Nine Tailors "

Senses:
1. definition=the products of human creativity; works of art collectively | synonyms=fine art | examples=an art exhibition; a fine collection of art
2. definition=the creation of beautiful or significant things | synonyms=artistic creation, artistic production | examples=art does not need to be innovative to be good; I was never any good at art
3. definition=a superior skill that you can learn by study and practice and observation | synonyms=artistry, prowess | examples=the art of conversation; it's quite an art
4. definition=photographs or other visual representations in a printed publication | synonyms=artwork, graphics, nontextual matter | examples=the publisher was responsible for all the artwork in the book

senseval2.d000.s000.t002 — “peculiar”

lemma peculiar · pos ADJ · 4 candidate senses

user

Which numbered sense of "peculiar" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: The art of change-ringing is <t>peculiar</t> to the English, and, like most English peculiarities, unintelligible to the rest of the world. Dorothy L. Sayers, "The Nine Tailors "

Senses:
1. definition=beyond or deviating from the usual or expected | synonyms=curious, funny, odd, queer, rum, rummy | examples=a curious hybrid accent; her speech has a funny twang
2. definition=unique or specific to a person or thing or category | synonyms=particular, special | examples=the particular demands of the job; has a particular preference for Chinese art
3. definition=markedly different from the usual; ; -Virginia Woolf | examples=a peculiar hobby of stuffing and mounting bats; a man...feels it a peculiar insult to be taunted with cowardice by a woman
4. definition=characteristic of one only; distinctive or special; - R.B.Taney | examples=the peculiar character of the Government of the U.S.

senseval2.d000.s000.t003 — “English”

lemma english · pos NOUN · 4 candidate senses

user

Which numbered sense of "english" (marked with <t></t>) is used in the context below? Return only the number of the correct sense.

Context: The art of change-ringing is peculiar to the <t>English</t>, and, like most English peculiarities, unintelligible to the rest of the world. Dorothy L. Sayers, "The Nine Tailors "

Senses:
1. definition=an Indo-European language belonging to the West Germanic branch; the official language of Britain and the United States and most of the commonwealth countries | synonyms=English language
2. definition=the people of England | synonyms=English people
3. definition=the discipline that studies the English language and literature
4. definition=(sports) the spin given to a ball by striking it on one side or releasing it with a sharp twist | synonyms=side