Artificial Intelligence
DeepSeek R1 Explained — Open Reasoning Model
DeepSeek R1 is an open-weights reasoning model released January 2025 that matched OpenAI o1 and triggered a $589B Nvidia stock drop.
mixture of experts
3 articles tagged with #mixture of experts
Artificial Intelligence
Llama 4 Explained — Meta's Open AI Models
Llama 4 is Meta's April 2025 open AI family — Scout, Maverick, and the shelved Behemoth — with native multimodal input and a 10M-token context window.
Artificial Intelligence
Mixture of Experts Routing: How MoE Models Decide Which Experts Fire
How Mixture of Experts routing actually works — token-choice vs expert-choice routing, load-balancing losses, and how DeepSeek-V3 solved expert collapse.