SenseBench

Prompts

p002: Minimal Single-Sentence Prompt

Minimal English Word Sense Disambiguation prompt: only the target sentence, detokenized from the Penn-Treebank-style source tokens into natural English (punctuation, contractions, and quotation marks restored) before the target is marked with <t>...</t>. Candidate senses give an index, definition, and at most one usage example, ordered by WordNet frequency; the model returns a plain integer.

⬇ Download p002.json

Prompt Metadata

ID
p002
Schema
sensebench-prompt-v1
Template
chat_messages
Output
plain_sense_index
Supersedes
n/a

Rendering Parameters

{
  "previous_sentences": 0,
  "next_sentences": 0,
  "target_marker": "xml_t",
  "sense_order": "frequency",
  "candidate_format": "compact_labeled_inline",
  "include_wordnet_id": false,
  "wordnet_id_kind": "none",
  "include_definition": true,
  "include_examples": true,
  "examples_max_per_sense": 1,
  "include_pos": false,
  "include_synonyms": false,
  "synonyms_max_per_sense": 0,
  "detokenize": true
}

Messages

user

Which numbered sense of "{{target_lemma}}" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: {{context}}

Senses:
{{candidate_senses}}

Rendered Item Examples

This prompt rendered against 3 sample items from the lexEN dataset — exactly the text sent to the model, with candidate senses, the context window, and the target marker filled in.

senseval2.d000.s000.t000 — “art”

lemma art · pos NOUN · 4 candidate senses

user

Which numbered sense of "art" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The <t>art</t> of change-ringing is peculiar to the English, and, like most English peculiarities, unintelligible to the rest of the world.

Senses:
1. definition=the products of human creativity; works of art collectively | examples=an art exhibition
2. definition=the creation of beautiful or significant things | examples=art does not need to be innovative to be good
3. definition=a superior skill that you can learn by study and practice and observation | examples=the art of conversation
4. definition=photographs or other visual representations in a printed publication | examples=the publisher was responsible for all the artwork in the book

senseval2.d000.s000.t002 — “peculiar”

lemma peculiar · pos ADJ · 4 candidate senses

user

Which numbered sense of "peculiar" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The art of change-ringing is <t>peculiar</t> to the English, and, like most English peculiarities, unintelligible to the rest of the world.

Senses:
1. definition=beyond or deviating from the usual or expected | examples=a curious hybrid accent
2. definition=unique or specific to a person or thing or category | examples=the particular demands of the job
3. definition=markedly different from the usual; ; -Virginia Woolf | examples=a peculiar hobby of stuffing and mounting bats
4. definition=characteristic of one only; distinctive or special; - R.B.Taney | examples=the peculiar character of the Government of the U.S.

senseval2.d000.s000.t003 — “English”

lemma english · pos NOUN · 4 candidate senses

user

Which numbered sense of "english" (marked with <t></t>) is used in the sentence below? Return only the number of the correct sense.

Sentence: The art of change-ringing is peculiar to the <t>English</t>, and, like most English peculiarities, unintelligible to the rest of the world.

Senses:
1. definition=an Indo-European language belonging to the West Germanic branch; the official language of Britain and the United States and most of the commonwealth countries
2. definition=the people of England
3. definition=the discipline that studies the English language and literature
4. definition=(sports) the spin given to a ball by striking it on one side or releasing it with a sharp twist