Tree of Thoughts: Deliberate Problem Solving with Large Language Models

Wrap a frozen GPT-4 in tree search — branch, self-evaluate, prune. Game of 24: 4% to 74%.

Yao et al. · NeurIPS 2023 · Reasoning & RL. Read the paper ↗

A free, interactive, animated visual explainer of Tree of Thoughts: Deliberate Problem Solving with Large Language Models — every exhibit computed from the real formulas, with verbatim quotes from the source.

Questions

What is Tree of Thoughts: Deliberate Problem Solving with Large Language Models?

Wrap a frozen GPT-4 in tree search — branch, self-evaluate, prune. Game of 24: 4% to 74%.

Who published Tree of Thoughts: Deliberate Problem Solving with Large Language Models, and where?

Yao et al. — NeurIPS 2023 (arXiv:2305.10601).

Where can I find a visual explainer of Tree of Thoughts: Deliberate Problem Solving with Large Language Models?

Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.

Related explainers

• DeepSeek-R1
• Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
• Training language models to follow instructions with human feedback
• Direct Preference Optimization: Your Language Model is Secretly a Reward Model
• DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
• Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
• Constitutional AI: Harmlessness from AI Feedback
• DAPO: An Open-Source LLM Reinforcement Learning System at Scale