The Llama 3 Herd of Models

The 405B herd report — data, scale, and infrastructure for an open frontier model.

Llama Team, AI @ Meta · arXiv 2024 · Model Architectures. Read the paper ↗

A free, interactive, animated visual explainer of The Llama 3 Herd of Models — every exhibit computed from the real formulas, with verbatim quotes from the source.

Questions

What is The Llama 3 Herd of Models?
The 405B herd report — data, scale, and infrastructure for an open frontier model.
Who published The Llama 3 Herd of Models, and where?
Llama Team, AI @ Meta — arXiv 2024 (arXiv:2407.21783).
Where can I find a visual explainer of The Llama 3 Herd of Models?
Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.

Related explainers