PaPoo
日本語 / English
cover
aiterms
Author
aiterms
#prompting#ai-glossary

What is self-consistency?

Self-consistency is a way to get a language model to answer by generating several reasoning paths and then choosing the answer that appears most often, instead of trusting a single chain of thought.

Why it matters

A single reasoning trace from an LLM can be brittle: one unlucky step can derail the final answer. Self-consistency helps when the task needs multi-step reasoning, such as math word problems, logic puzzles, or multi-hop question answering.

In practice, you reach for it when you want a cheap reliability boost without changing the model itself. It is especially useful when the model can produce different valid reasoning paths that still lead to the same final answer.

How it works

The basic idea is simple:

  1. Ask the model the same question multiple times, usually with sampling enabled so the outputs vary.
  2. Each run produces a different reasoning path and a final answer.
  3. Extract the final answer from each run.
  4. Pick the answer that shows up most often.

This is usually described in the paper “Self-Consistency Improves Chain of Thought Reasoning in Language Models” (Wang et al., 2022). The intuition is that if many different reasoning paths converge on the same result, that result is more likely to be correct than the answer from just one sampled path.

It is not the same as majority voting over arbitrary text. The voting is typically over the model’s final answer after reasoning, which matters because the reasoning text itself can vary a lot.

Tiny concrete example

Suppose you ask:

If a book costs $12 and you get a 25% discount, what is the final price?

You sample the model 5 times. The reasoning may differ, but the final answers come back as:

Self-consistency returns $9, because that is the most common final answer.

Common pitfalls / when NOT to use it

If you want one practical rule: start with a single well-prompted run, then add self-consistency when accuracy matters more than cost.

What is self-consistency?

Self-consistency is a way to get a language model to answer by generating several reasoning paths and then choosing the answer that appears most often, instead of trusting a single chain of thought.

Why it matters

A single reasoning trace from an LLM can be brittle: one unlucky step can derail the final answer. Self-consistency helps when the task needs multi-step reasoning, such as math word problems, logic puzzles, or multi-hop question answering.

In practice, you reach for it when you want a cheap reliability boost without changing the model itself. It is especially useful when the model can produce different valid reasoning paths that still lead to the same final answer.

How it works

The basic idea is simple:

  1. Ask the model the same question multiple times, usually with sampling enabled so the outputs vary.
  2. Each run produces a different reasoning path and a final answer.
  3. Extract the final answer from each run.
  4. Pick the answer that shows up most often.

This is usually described in the paper “Self-Consistency Improves Chain of Thought Reasoning in Language Models” (Wang et al., 2022). The intuition is that if many different reasoning paths converge on the same result, that result is more likely to be correct than the answer from just one sampled path.

It is not the same as majority voting over arbitrary text. The voting is typically over the model’s final answer after reasoning, which matters because the reasoning text itself can vary a lot.

Tiny concrete example

Suppose you ask:

If a book costs $12 and you get a 25% discount, what is the final price?

You sample the model 5 times. The reasoning may differ, but the final answers come back as:

Self-consistency returns $9, because that is the most common final answer.

Common pitfalls / when NOT to use it

If you want one practical rule: start with a single well-prompted run, then add self-consistency when accuracy matters more than cost.

Related terms

X に投稿 BlueSky に投稿
同じ著者の記事
What is meta-prompting?
What is meta-prompting?
Meta-prompting is the practice of using one prompt to design, improve, or control another prompt, rather than asking the model to do the task directly. It helps when a plain prompt is too vague, too brittle, or too hard to maintain. Instead of hand-tuning a long instruction by trial and error, you can ask an LLM to generate, refine, critique, or transform prompts for you. In practice, teams reach for meta-prompting when they want: better prompt quality with less manual iteration, reusable prompt
papoo.work
What is tree-of-thought prompting?
What is tree-of-thought prompting?
Tree-of-thought prompting, often abbreviated ToT, is a prompting method where an LLM explores multiple reasoning branches instead of committing to a single straight-line answer. Tree-of-thought prompting is useful when a problem benefits from deliberate search: puzzle solving, planning, multi-step reasoning, or tasks where an early mistake can derail the whole answer. In practice, it gives the model a way to "think in branches," then compare candidates before choosing one. You'd reach for To
papoo.work
What is using XML tags / delimiters in prompts?
What is using XML tags / delimiters in prompts?
Using XML tags or other delimiters in prompts means wrapping parts of your prompt in clear markers like `<context>...</context>` so the model can separate instructions, data, and examples more reliably. This pattern helps when a prompt contains multiple kinds of content at once: instructions, source text, user input, examples, or fields you want the model to treat differently. Delimiters reduce ambiguity and make prompts easier to read, debug, and reuse. In practice, teams reach for XML-style ta
papoo.work
What is a prompt template?
What is a prompt template?
A prompt template is a reusable prompt with placeholders for variable details, so you can generate consistent LLM inputs without rewriting the whole prompt each time. Prompt templates solve a simple but common problem: most prompts are partly fixed and partly changing. In practice, they help you: keep instructions consistent across many requests swap in user-specific data, documents, or task details reduce copy-paste errors when building apps, workflows, or evals make prompts easier to version,
papoo.work
What is structured output (JSON mode)?
What is structured output (JSON mode)?
Structured output, often called JSON mode, is a way to ask an LLM to return data in a fixed machine-readable format instead of free-form text. When you want an answer that another program can safely parse, plain chat text is fragile. A model might add extra words, change field names, or wrap the result in an explanation. Structured output helps when you need: predictable API responses reliable extraction into downstream systems cleaner automation for forms, workflows, or tools outputs that match
papoo.work
What is prompt engineering?
What is prompt engineering?
Prompt engineering is the practice of designing and refining the text you give to a language model so it produces more useful, reliable, and specific outputs. Large language models are sensitive to how you ask. A vague request can produce a vague answer; a well-structured prompt can improve format, scope, tone, and task performance. You reach for prompt engineering when you want to: get a model to follow instructions more consistently, steer it toward a role, style, or output format, reduce back
papoo.work
What is a system prompt?
What is a system prompt?
A system prompt is the instruction text that sets the assistant’s role, behavior, and boundaries before the user’s message is processed. System prompts help you control how an LLM behaves without changing the model itself. They’re useful when you want consistent tone, safety rules, formatting, or task-specific behavior across many requests. In practice, teams use system prompts to: keep outputs on-brand, enforce policies or guardrails, define what the assistant should and should not do, reduce a
papoo.work
What is few-shot prompting?
What is few-shot prompting?
Few-shot prompting, also called in-context learning, is a way of asking a language model to do a task by giving it a few example inputs and outputs in the prompt. Few-shot prompting helps when you want the model to follow a pattern, format, or classification rule without training or fine-tuning a new model. You’d reach for it when: the task is simple but the output needs to be consistent, you can show the model 1–5 good examples, you want to prototype quickly before investing in fine-tuning
papoo.work
What is zero-shot prompting?
What is zero-shot prompting?
Zero-shot prompting is asking an AI model to do a task without giving it any worked examples first. It is the simplest way to use a large language model: you describe the task in plain language and let the model infer the pattern from its pretraining. That makes it useful when you want: a fast baseline before writing better prompts simple classification, extraction, or drafting tasks lower prompt length and less example curation a test of whether the model already “gets” the task well enough In
papoo.work
What is chain-of-thought prompting?
What is chain-of-thought prompting?
Chain-of-thought prompting, often abbreviated CoT, is a way of asking a language model to produce intermediate reasoning steps before giving the final answer. It is used to improve performance on tasks that benefit from multi-step reasoning, such as arithmetic, logic, and some question-answering problems. In practice, teams reach for CoT when a direct one-line answer is more likely to be wrong than a stepwise solution. It can also make model behavior easier to inspect: if the model shows its
papoo.work