Negative Self-Distillation: Learning to Reason by Avoiding Flaws

Negative Self-Distillation (NSD) improves reasoning by optimizing models to diverge from flawed reasoning traces rather than imitating privileged ground-truth solutions. This framework addresses On-Policy Self-Distillation's tendency to suppress uncertainty and self-correction by training the model to identify and avoid specific negative conditions generated during the reasoning process.