Persistent Negatives Stabilize Black-Box On-Policy Distillation
September 28, 2026
A new distillation method addresses the moving-target problem in black-box on-policy distillation by using a live pool of historical teacher-student comparisons. This approach stabilizes discriminator training while allowing GRPO to remain on-policy with fresh student responses.
HOW THIS AFFECTS YOU
●
researcherYou can improve distillation stability in black-box settings by decoupling reward training from the latest policy updates.