CADENCE Framework for Coverage-Adaptive On-Policy Distillation

CADENCE addresses cold-start collapse and reward sparsity in knowledge distillation using a DRIFT mechanism. It employs a per-token convex mixture of forward-KL and reverse-KL objectives on student-sampled trajectories to bridge the reasoning gap between large teachers and compact students.