Gemma 4

Five sizes, one design — interleaved local/global sliding-window attention, now with MoE.

Google DeepMind · 2026 · Model Architectures. Read the paper ↗

A free, interactive, animated visual explainer of Gemma 4 — every exhibit computed from the real formulas, with verbatim quotes from the source.

Questions

What is Gemma 4?
Five sizes, one design — interleaved local/global sliding-window attention, now with MoE.
Who published Gemma 4, and where?
Google DeepMind — 2026 (its official release).
Where can I find a visual explainer of Gemma 4?
Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.

Related explainers