Gemma 4
Five sizes, one design — interleaved local/global sliding-window attention, now with MoE.
Google DeepMind · 2026 · Model Architectures. Read the paper ↗
A free, interactive, animated visual explainer of Gemma 4 — every exhibit computed from the real formulas, with verbatim quotes from the source.
Questions
- What is Gemma 4?
- Five sizes, one design — interleaved local/global sliding-window attention, now with MoE.
- Who published Gemma 4, and where?
- Google DeepMind — 2026 (its official release).
- Where can I find a visual explainer of Gemma 4?
- Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.
Related explainers
- DeepSeek-V3
- Qwen3
- OLMo 2
- MiniMax-01
- Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
- DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
- Learning Transferable Visual Models From Natural Language Supervision
- Scalable Diffusion Models with Transformers