Outside the Purview of the Reward: Capability Drift in Multilingual Post-Training

GRPO-based post-training in multilingual MoE models causes capability drift, where a 36.07 point MATH gain coincides with a 19.32 F1 point loss on XQuAD-Indic. Decomposition shows most MATH improvements stem from increased boxed-answer emission rather than improved reasoning. Reward-free distillation from earlier checkpoints can partially recover lost multilingual F1 scores.