https://research.rudrite.com/2026-06-09monthly1.0https://research.rudrite.com/og/default.pngRudrite Research — AI & ML papers, made legible https://research.rudrite.com/library2026-06-09monthly0.6https://research.rudrite.com/og/default.pngThe library — every AI & ML paper explainer | Rudrite Research https://research.rudrite.com/attention2026-06-05monthly0.8https://research.rudrite.com/og/attention.pngAttention Is All You Need — interactive visual explainer | Rudrite Research https://research.rudrite.com/flash-attention2026-06-05monthly0.8https://research.rudrite.com/og/flash-attention.pngFlashAttention — interactive visual explainer | Rudrite Research https://research.rudrite.com/paged-attention2026-06-05monthly0.8https://research.rudrite.com/og/paged-attention.pngPagedAttention (vLLM) — interactive visual explainer | Rudrite Research https://research.rudrite.com/megatron-lm2026-06-05monthly0.8https://research.rudrite.com/og/megatron-lm.pngMegatron-LM — interactive visual explainer | Rudrite Research https://research.rudrite.com/deepseek-r12026-06-05monthly0.8https://research.rudrite.com/og/deepseek-r1.pngDeepSeek-R1 — interactive visual explainer | Rudrite Research https://research.rudrite.com/gpt-32026-06-05monthly0.8https://research.rudrite.com/og/gpt-3.pngGPT-3: Language Models are Few-Shot Learners — interactive visual explainer | Rudrite Research https://research.rudrite.com/zero2026-06-05monthly0.8https://research.rudrite.com/og/zero.pngZeRO: Zero Redundancy Optimizer — interactive visual explainer | Rudrite Research https://research.rudrite.com/mixtral2026-06-05monthly0.8https://research.rudrite.com/og/mixtral.pngMixtral of Experts — interactive visual explainer | Rudrite Research https://research.rudrite.com/chinchilla2026-06-05monthly0.8https://research.rudrite.com/og/chinchilla.pngTraining Compute-Optimal Large Language Models — interactive visual explainer | Rudrite Research https://research.rudrite.com/mamba2026-06-05monthly0.8https://research.rudrite.com/og/mamba.pngMamba: Linear-Time Sequence Modeling with Selective State Spaces — interactive visual explainer | Rudrite Research https://research.rudrite.com/bert2026-06-05monthly0.8https://research.rudrite.com/og/bert.pngBERT: Pre-training of Deep Bidirectional Transformers — interactive visual explainer | Rudrite Research https://research.rudrite.com/deepseek-v32026-06-07monthly0.8https://research.rudrite.com/og/deepseek-v3.pngDeepSeek-V3 — interactive visual explainer | Rudrite Research https://research.rudrite.com/qwen32026-06-07monthly0.8https://research.rudrite.com/og/qwen3.pngQwen3 — interactive visual explainer | Rudrite Research https://research.rudrite.com/olmo-22026-06-07monthly0.8https://research.rudrite.com/og/olmo-2.pngOLMo 2 — interactive visual explainer | Rudrite Research https://research.rudrite.com/minimax-012026-06-07monthly0.8https://research.rudrite.com/og/minimax-01.pngMiniMax-01 — interactive visual explainer | Rudrite Research https://research.rudrite.com/gemma-42026-06-07monthly0.8https://research.rudrite.com/og/gemma-4.pngGemma 4 — interactive visual explainer | Rudrite Research https://research.rudrite.com/scaling-laws2026-06-09monthly0.8https://research.rudrite.com/og/scaling-laws.pngScaling Laws for Neural Language Models — interactive visual explainer | Rudrite Research https://research.rudrite.com/adam2026-06-09monthly0.8https://research.rudrite.com/og/adam.pngAdam: A Method for Stochastic Optimization — interactive visual explainer | Rudrite Research https://research.rudrite.com/resnet2026-06-09monthly0.8https://research.rudrite.com/og/resnet.pngDeep Residual Learning for Image Recognition — interactive visual explainer | Rudrite Research https://research.rudrite.com/ddpm2026-06-09monthly0.8https://research.rudrite.com/og/ddpm.pngDenoising Diffusion Probabilistic Models — interactive visual explainer | Rudrite Research https://research.rudrite.com/switch-transformers2026-06-09monthly0.8https://research.rudrite.com/og/switch-transformers.pngSwitch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity — interactive visual explainer | Rudrite Research https://research.rudrite.com/lora2026-06-09monthly0.8https://research.rudrite.com/og/lora.pngLoRA: Low-Rank Adaptation of Large Language Models — interactive visual explainer | Rudrite Research https://research.rudrite.com/gpipe2026-06-09monthly0.8https://research.rudrite.com/og/gpipe.pngGPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism — interactive visual explainer | Rudrite Research https://research.rudrite.com/gspmd2026-06-09monthly0.8https://research.rudrite.com/og/gspmd.pngGSPMD: General and Scalable Parallelization for ML Computation Graphs — interactive visual explainer | Rudrite Research https://research.rudrite.com/pathways2026-06-09monthly0.8https://research.rudrite.com/og/pathways.pngPathways: Asynchronous Distributed Dataflow for ML — interactive visual explainer | Rudrite Research https://research.rudrite.com/ring-attention2026-06-09monthly0.8https://research.rudrite.com/og/ring-attention.pngRing Attention with Blockwise Transformers for Near-Infinite Context — interactive visual explainer | Rudrite Research https://research.rudrite.com/scaling-inference2026-06-09monthly0.8https://research.rudrite.com/og/scaling-inference.pngEfficiently Scaling Transformer Inference — interactive visual explainer | Rudrite Research https://research.rudrite.com/mooncake2026-06-09monthly0.8https://research.rudrite.com/og/mooncake.pngMooncake: A KVCache-centric Disaggregated Architecture for LLM Serving — interactive visual explainer | Rudrite Research https://research.rudrite.com/speculative-decoding2026-06-09monthly0.8https://research.rudrite.com/og/speculative-decoding.pngFast Inference from Transformers via Speculative Decoding — interactive visual explainer | Rudrite Research https://research.rudrite.com/chain-of-thought2026-06-09monthly0.8https://research.rudrite.com/og/chain-of-thought.pngChain-of-Thought Prompting Elicits Reasoning in Large Language Models — interactive visual explainer | Rudrite Research https://research.rudrite.com/instructgpt2026-06-09monthly0.8https://research.rudrite.com/og/instructgpt.pngTraining language models to follow instructions with human feedback — interactive visual explainer | Rudrite Research https://research.rudrite.com/dpo2026-06-09monthly0.8https://research.rudrite.com/og/dpo.pngDirect Preference Optimization: Your Language Model is Secretly a Reward Model — interactive visual explainer | Rudrite Research https://research.rudrite.com/deepseekmath2026-06-09monthly0.8https://research.rudrite.com/og/deepseekmath.pngDeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models — interactive visual explainer | Rudrite Research https://research.rudrite.com/test-time-compute2026-06-09monthly0.8https://research.rudrite.com/og/test-time-compute.pngScaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters — interactive visual explainer | Rudrite Research https://research.rudrite.com/constitutional-ai2026-06-09monthly0.8https://research.rudrite.com/og/constitutional-ai.pngConstitutional AI: Harmlessness from AI Feedback — interactive visual explainer | Rudrite Research https://research.rudrite.com/dapo2026-06-09monthly0.8https://research.rudrite.com/og/dapo.pngDAPO: An Open-Source LLM Reinforcement Learning System at Scale — interactive visual explainer | Rudrite Research https://research.rudrite.com/tree-of-thoughts2026-06-09monthly0.8https://research.rudrite.com/og/tree-of-thoughts.pngTree of Thoughts: Deliberate Problem Solving with Large Language Models — interactive visual explainer | Rudrite Research https://research.rudrite.com/react2026-06-09monthly0.8https://research.rudrite.com/og/react.pngReAct: Synergizing Reasoning and Acting in Language Models — interactive visual explainer | Rudrite Research https://research.rudrite.com/flash-attention-32026-06-09monthly0.8https://research.rudrite.com/og/flash-attention-3.pngFlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision — interactive visual explainer | Rudrite Research https://research.rudrite.com/mamba-22026-06-09monthly0.8https://research.rudrite.com/og/mamba-2.pngTransformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality — interactive visual explainer | Rudrite Research https://research.rudrite.com/deepseek-v22026-06-09monthly0.8https://research.rudrite.com/og/deepseek-v2.pngDeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model — interactive visual explainer | Rudrite Research https://research.rudrite.com/eagle2026-06-09monthly0.8https://research.rudrite.com/og/eagle.pngEAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty — interactive visual explainer | Rudrite Research https://research.rudrite.com/awq2026-06-09monthly0.8https://research.rudrite.com/og/awq.pngAWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration — interactive visual explainer | Rudrite Research https://research.rudrite.com/rope2026-06-09monthly0.8https://research.rudrite.com/og/rope.pngRoFormer: Enhanced Transformer with Rotary Position Embedding — interactive visual explainer | Rudrite Research https://research.rudrite.com/vision-transformer2026-06-09monthly0.8https://research.rudrite.com/og/vision-transformer.pngAn Image is Worth 16x16 Words: Transformers for Image Recognition at Scale — interactive visual explainer | Rudrite Research https://research.rudrite.com/clip2026-06-09monthly0.8https://research.rudrite.com/og/clip.pngLearning Transferable Visual Models From Natural Language Supervision — interactive visual explainer | Rudrite Research https://research.rudrite.com/latent-diffusion2026-06-09monthly0.8https://research.rudrite.com/og/latent-diffusion.pngHigh-Resolution Image Synthesis with Latent Diffusion Models — interactive visual explainer | Rudrite Research https://research.rudrite.com/dit2026-06-09monthly0.8https://research.rudrite.com/og/dit.pngScalable Diffusion Models with Transformers — interactive visual explainer | Rudrite Research https://research.rudrite.com/whisper2026-06-09monthly0.8https://research.rudrite.com/og/whisper.pngRobust Speech Recognition via Large-Scale Weak Supervision — interactive visual explainer | Rudrite Research https://research.rudrite.com/native-sparse-attention2026-06-09monthly0.8https://research.rudrite.com/og/native-sparse-attention.pngNative Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention — interactive visual explainer | Rudrite Research https://research.rudrite.com/gspo2026-06-09monthly0.8https://research.rudrite.com/og/gspo.pngGroup Sequence Policy Optimization — interactive visual explainer | Rudrite Research https://research.rudrite.com/distserve2026-06-09monthly0.8https://research.rudrite.com/og/distserve.pngDistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving — interactive visual explainer | Rudrite Research https://research.rudrite.com/cacheblend2026-06-09monthly0.8https://research.rudrite.com/og/cacheblend.pngCacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion — interactive visual explainer | Rudrite Research https://research.rudrite.com/gshard2026-06-09monthly0.8https://research.rudrite.com/og/gshard.pngGShard: Scaling Giant Models with Conditional Computation and Automatic Sharding — interactive visual explainer | Rudrite Research https://research.rudrite.com/gqa2026-06-09monthly0.8https://research.rudrite.com/og/gqa.pngGQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints — interactive visual explainer | Rudrite Research https://research.rudrite.com/yarn2026-06-09monthly0.8https://research.rudrite.com/og/yarn.pngYaRN: Efficient Context Window Extension of Large Language Models — interactive visual explainer | Rudrite Research https://research.rudrite.com/streaming-llm2026-06-09monthly0.8https://research.rudrite.com/og/streaming-llm.pngEfficient Streaming Language Models with Attention Sinks — interactive visual explainer | Rudrite Research https://research.rudrite.com/gan2026-06-09monthly0.8https://research.rudrite.com/og/gan.pngGenerative Adversarial Networks — interactive visual explainer | Rudrite Research https://research.rudrite.com/segment-anything2026-06-09monthly0.8https://research.rudrite.com/og/segment-anything.pngSegment Anything — interactive visual explainer | Rudrite Research https://research.rudrite.com/llava2026-06-09monthly0.8https://research.rudrite.com/og/llava.pngVisual Instruction Tuning — interactive visual explainer | Rudrite Research https://research.rudrite.com/compare/transformers-vs-mamba2026-06-08monthly0.8https://research.rudrite.com/og/compare-transformers-vs-mamba.pngTransformers vs Mamba — what's the difference? | Rudrite Research https://research.rudrite.com/compare/flashattention-vs-pagedattention2026-06-08monthly0.8https://research.rudrite.com/og/compare-flashattention-vs-pagedattention.pngFlashAttention vs PagedAttention — what's the difference? | Rudrite Research https://research.rudrite.com/compare/dense-vs-mixture-of-experts2026-06-08monthly0.8https://research.rudrite.com/og/compare-dense-vs-mixture-of-experts.pngDense vs Mixture-of-Experts — what's the difference? | Rudrite Research https://research.rudrite.com/compare/ppo-vs-dpo-vs-grpo2026-06-09monthly0.8https://research.rudrite.com/og/compare-ppo-vs-dpo-vs-grpo.pngPPO vs DPO vs GRPO — what's the difference? | Rudrite Research https://research.rudrite.com/compare/mha-vs-gqa-vs-mla2026-06-09monthly0.8https://research.rudrite.com/og/compare-mha-vs-gqa-vs-mla.pngMHA vs GQA vs MLA — what's the difference? | Rudrite Research https://research.rudrite.com/compare/gan-vs-vae-vs-diffusion2026-06-09monthly0.8https://research.rudrite.com/og/compare-gan-vs-vae-vs-diffusion.pngGAN vs VAE vs Diffusion — what's the difference? | Rudrite Research https://research.rudrite.com/compare/flashattention-vs-flashattention-32026-06-09monthly0.8https://research.rudrite.com/og/compare-flashattention-vs-flashattention-3.pngFlashAttention vs FlashAttention-3 — what's the difference? | Rudrite Research