Robust Speech Recognition via Large-Scale Weak Supervision

680k hours of weak supervision → one Transformer that transcribes the real world, zero-shot

Radford et al. · ICML 2023 · Foundations. Read the paper ↗

A free, interactive, animated visual explainer of Robust Speech Recognition via Large-Scale Weak Supervision — every exhibit computed from the real formulas, with verbatim quotes from the source.

Questions

What is Robust Speech Recognition via Large-Scale Weak Supervision?

680k hours of weak supervision → one Transformer that transcribes the real world, zero-shot

Who published Robust Speech Recognition via Large-Scale Weak Supervision, and where?

Radford et al. — ICML 2023 (arXiv:2212.04356).

Where can I find a visual explainer of Robust Speech Recognition via Large-Scale Weak Supervision?

Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.

Related explainers

• Attention Is All You Need
• GPT-3: Language Models are Few-Shot Learners
• Mixtral of Experts
• Training Compute-Optimal Large Language Models
• Mamba: Linear-Time Sequence Modeling with Selective State Spaces
• BERT: Pre-training of Deep Bidirectional Transformers
• Scaling Laws for Neural Language Models
• Adam: A Method for Stochastic Optimization