Woodpecker Distillation Uses Weak Models to Fix Strong Model Reasoning

Woodpecker Distillation is a weak-to-strong training framework that uses small probe models to identify and patch localized reasoning bugs in larger models. Instead of fine-tuning on corrected text, it learns by contrasting successful and unsuccessful interventions to reshape the model's reasoning distribution.