Efficiently Modeling Long Sequences with Structured State Spaces

A state-space layer that models 16k-long sequences — the origin of the line that leads to Mamba.

Gu et al. · ICLR 2022 · Model Architectures. Read the paper ↗

A free, interactive, animated visual explainer of Efficiently Modeling Long Sequences with Structured State Spaces — every exhibit computed from the real formulas, with verbatim quotes from the source.

Questions

What is Efficiently Modeling Long Sequences with Structured State Spaces?

A state-space layer that models 16k-long sequences — the origin of the line that leads to Mamba.

Who published Efficiently Modeling Long Sequences with Structured State Spaces, and where?

Gu et al. — ICLR 2022 (arXiv:2111.00396).

Where can I find a visual explainer of Efficiently Modeling Long Sequences with Structured State Spaces?

Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.

Related explainers

• DeepSeek-V3
• Qwen3
• OLMo 2
• MiniMax-01
• Gemma 4
• Ring Attention with Blockwise Transformers for Near-Infinite Context
• Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
• DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model