Artificial Intelligence
Mixture of Experts Routing: How MoE Models Decide Which Experts Fire
How Mixture of Experts routing actually works — token-choice vs expert-choice routing, load-balancing losses, and how DeepSeek-V3 solved expert collapse.
moe-routing
1 article tagged with #moe-routing