Learning Transferable Visual Models From Natural Language Supervision

Match captions to images, and you get a classifier for any concept you can name.

Radford et al. · ICML 2021 · Foundations. Read the paper ↗

A free, interactive, animated visual explainer of Learning Transferable Visual Models From Natural Language Supervision — every exhibit computed from the real formulas, with verbatim quotes from the source.

Questions

What is Learning Transferable Visual Models From Natural Language Supervision?

Match captions to images, and you get a classifier for any concept you can name.

Who published Learning Transferable Visual Models From Natural Language Supervision, and where?

Radford et al. — ICML 2021 (arXiv:2103.00020).

Where can I find a visual explainer of Learning Transferable Visual Models From Natural Language Supervision?

Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.

Related explainers

• Attention Is All You Need
• GPT-3: Language Models are Few-Shot Learners
• Mixtral of Experts
• Training Compute-Optimal Large Language Models
• Mamba: Linear-Time Sequence Modeling with Selective State Spaces
• BERT: Pre-training of Deep Bidirectional Transformers
• Gemma 4
• Scaling Laws for Neural Language Models