Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Let a state-space model read what it's reading — and a recurrence outruns attention.

Gu, Dao · 2023 · Foundations. Read the paper ↗

A free, interactive, animated visual explainer of Mamba: Linear-Time Sequence Modeling with Selective State Spaces — every exhibit computed from the real formulas, with verbatim quotes from the source.

Questions

What is Mamba: Linear-Time Sequence Modeling with Selective State Spaces?

Let a state-space model read what it's reading — and a recurrence outruns attention.

Who published Mamba: Linear-Time Sequence Modeling with Selective State Spaces, and where?

Gu, Dao — 2023 (arXiv:2312.00752).

Where can I find a visual explainer of Mamba: Linear-Time Sequence Modeling with Selective State Spaces?

Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.

Related explainers

• Attention Is All You Need
• GPT-3: Language Models are Few-Shot Learners
• Mixtral of Experts
• Training Compute-Optimal Large Language Models
• BERT: Pre-training of Deep Bidirectional Transformers
• Scaling Laws for Neural Language Models
• Adam: A Method for Stochastic Optimization
• Deep Residual Learning for Image Recognition