Geometric Routing Unlocks Causal Control in Mixture of Experts Models
Researchers demonstrate that individual experts in sparse Mixture-of-Experts (MoE) models have causally meaningful identities. This discovery enables more precise control over model behavior through geometric routing techniques.