Artificial Intelligence
Mixture of Experts Routing: How MoE Models Decide Which Experts Fire
How Mixture of Experts routing actually works — token-choice vs expert-choice routing, load-balancing losses, and how DeepSeek-V3 solved expert collapse.
expert-choice
1 article tagged with #expert-choice