ISSUE 11.15.26/24 CATEGORIES

switch-transformer

1 article tagged with #switch-transformer

Close-up of blue liquid being poured into glass test tubes in a laboratory setting.

Mixture of Experts Routing: How MoE Models Decide Which Experts Fire

How Mixture of Experts routing actually works — token-choice vs expert-choice routing, load-balancing losses, and how DeepSeek-V3 solved expert collapse.

Editorial Team·May 17, 2026·25 min