Chain-of-Thought (CoT) Prompting

Appears in 2 papers

A prompting technique where intermediate reasoning steps are shown in few-shot examples, causing language models to generate their own step-by-step reasoning before producing a final answer.

As used in Paper 14 — Chain-of-Thought Prompting Elicits Reasoning in Large Language Models →

A prompting technique where intermediate reasoning steps are shown in few-shot examples, causing language models to generate their own step-by-step reasoning before producing a final answer. Instead of providing just (question, answer) pairs, CoT examples show (question, reasoning steps, answer) triples. This technique is most effective for large models (100B+ parameters) on multi-step reasoning tasks like math and logic.

As used in Paper 24 — rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking →

Solving problems by writing out reasoning step-by-step in natural language. Works well but requires humans to verify correctness.