Mistral 7B
Sliding-window attention + GQA — the 7B that beat 13B and started the small-model race.
Jiang et al. · arXiv 2023 · Model Architectures. Read the paper ↗
A free, interactive, animated visual explainer of Mistral 7B — every exhibit computed from the real formulas, with verbatim quotes from the source.
Questions
- What is Mistral 7B?
- Sliding-window attention + GQA — the 7B that beat 13B and started the small-model race.
- Who published Mistral 7B, and where?
- Jiang et al. — arXiv 2023 (arXiv:2310.06825).
- Where can I find a visual explainer of Mistral 7B?
- Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.