On-Policy Delta Distillation for Reasoning Capability Transfer
July 17, 2026
On-Policy Delta Distillation introduces a delta signal defined as the difference between a teacher model and its base model. This signal captures specific reasoning changes from instruction tuning, providing more effective token-level supervision than direct distribution imitation.
HOW THIS AFFECTS YOU
●
builderYou can improve the transfer of reasoning capabilities during post-training distillation.
●
researcherThis method offers a more direct signal for transferring reasoning capabilities compared to standard imitation.