Mistral 7B

Sliding-window attention + GQA — the 7B that beat 13B and started the small-model race.

Jiang et al. · arXiv 2023 · Model Architectures. Read the paper ↗

A free, interactive, animated visual explainer of Mistral 7B — every exhibit computed from the real formulas, with verbatim quotes from the source.

Questions

What is Mistral 7B?
Sliding-window attention + GQA — the 7B that beat 13B and started the small-model race.
Who published Mistral 7B, and where?
Jiang et al. — arXiv 2023 (arXiv:2310.06825).
Where can I find a visual explainer of Mistral 7B?
Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.

Related explainers