Expert-Space Exploration Increases Rollout Diversity in MoE RL

Perturbing expert routing in Mixture-of-Experts (MoE) models can increase rollout diversity similarly to increasing decoding temperature. This method avoids the quality degradation of direct perturbation by specifically targeting the expert selection process during reinforcement learning.