Who published LoRA: Low-Rank Adaptation of Large Language Models, and where?

Hu et al. — ICLR 2022 (arXiv:2106.09685).

LoRA: Low-Rank Adaptation of Large Language Models

Freeze the model, learn its change as two skinny matrices — 10,000× fewer trainable weights, zero added latency.

Hu et al. · ICLR 2022 · Foundations. Read the paper ↗

A free, interactive, animated visual explainer of LoRA: Low-Rank Adaptation of Large Language Models — every exhibit computed from the real formulas, with verbatim quotes from the source.

Questions

What is LoRA: Low-Rank Adaptation of Large Language Models?: Freeze the model, learn its change as two skinny matrices — 10,000× fewer trainable weights, zero added latency.
Who published LoRA: Low-Rank Adaptation of Large Language Models, and where?: Hu et al. — ICLR 2022 (arXiv:2106.09685).
Where can I find a visual explainer of LoRA: Low-Rank Adaptation of Large Language Models?: Right here — a free, interactive, animated walkthrough of the whole paper, with exhibits computed from the real formulas and verbatim quotes from the source.

Related explainers

Attention Is All You Need
GPT-3: Language Models are Few-Shot Learners
Mixtral of Experts
Training Compute-Optimal Large Language Models
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
BERT: Pre-training of Deep Bidirectional Transformers
Scaling Laws for Neural Language Models
Adam: A Method for Stochastic Optimization