DiffGate Combines On-Policy Distillation and Reinforcement Learning

DiffGate addresses the mismatch between token-local on-policy distillation (OPD) and outcome-agnostic reinforcement learning (RLVR) by using difficulty-gated teacher guidance. It uses dense local teacher signals to supplement sparse, outcome-level rewards from methods like GRPO, improving trajectory-level reasoning.