Causal Control

Geometric Routing Unlocks Causal Control in Mixture of Experts Models

Researchers demonstrate that individual experts in sparse Mixture-of-Experts (MoE) models have causally meaningful identities. This discovery enables more precise control over model behavior through geometric routing techniques.