DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
A 7B open model hits 51.7% on MATH — by web-mining 120B math tokens and inventing GRPO.
Shao et al. · arXiv 2024 · Reasoning & RL. Read the paper ↗
A free, interactive, animated visual explainer of DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models — every exhibit computed from the real formulas, with verbatim quotes from the source.
Questions
- What is DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models?
- A 7B open model hits 51.7% on MATH — by web-mining 120B math tokens and inventing GRPO.
- Who published DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models, and where?
- Shao et al. — arXiv 2024 (arXiv:2402.03300).
- Where can I find a visual explainer of DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models?
- Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.
Related explainers
- DeepSeek-R1
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- Training language models to follow instructions with human feedback
- Direct Preference Optimization: Your Language Model is Secretly a Reward Model
- Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
- Constitutional AI: Harmlessness from AI Feedback
- DAPO: An Open-Source LLM Reinforcement Learning System at Scale
- Tree of Thoughts: Deliberate Problem Solving with Large Language Models