Minimal-Edit Distillation Reduces Perceptual Errors in Multimodal Reasoning

This method addresses VLM reasoning failures caused by initial image misinterpretation through corrective on-policy distillation. By using a teacher model to score only incorrect tokens during training, it enables smaller models to match larger models' reasoning performance without requiring text descriptions at inference time.