Sequential OPD-then-RLVR Outperforms Joint Optimization for Reasoning Models

A two-stage training scheme, applying on-policy distillation (OPD) before reinforcement learning with verifiable rewards (RLVR), consistently beats joint optimization methods. The study demonstrates that simultaneous optimization causes signal interference, whereas sequential training allows OPD to expand solution coverage and RL to sharpen precision.