OLMo 2
A fully-open model, stabilized by moving the norms to the output and clamping QK.
Ai2 · 2025 · Model Architectures. Read the paper ↗
A free, interactive, animated visual explainer of OLMo 2 — every exhibit computed from the real formulas, with verbatim quotes from the source.
Questions
- What is OLMo 2?
- A fully-open model, stabilized by moving the norms to the output and clamping QK.
- Who published OLMo 2, and where?
- Ai2 — 2025 (arXiv:2501.00656).
- Where can I find a visual explainer of OLMo 2?
- Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.
Related explainers
- DeepSeek-V3
- Qwen3
- MiniMax-01
- Gemma 4
- Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
- DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
- Scalable Diffusion Models with Transformers
- GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints