Reducing Erroneous Reasoning in On-Policy Distillation via CCE-OPD
October 16, 2026
Condition-Contrastive Extrapolated On-Policy Distillation (CCE-OPD) prevents student models from adopting teacher-favored invalid continuations. By using fixed-prefix comparisons and log-probability contrast, the method reduced preference for invalid continuations from 27.0% to 16.0% in reasoning tasks.
HOW THIS AFFECTS YOU
●
builderYou can use this to prevent student models from inheriting reasoning hallucinations during distillation.
●
researcherThis introduces a more robust way to condition teacher supervision on the specific premises of a prompt.