Cal-OPD Reduces Teacher-Student Discrepancy in Distillation
September 21, 2026
Calibrated On-Policy Distillation (Cal-OPD) improves reasoning models by using privileged interventions to isolate and remove teacher-side deviations from the distillation signal.
HOW THIS AFFECTS YOU
●
researcherYou can use this method to prevent students from learning teacher-specific noise during distillation.