PROOF-Gen: From Optimized Data to Better Distillation

PROOF-Gen replaces the standard generate-and-filter distillation method with an optimization approach that extracts signal from teacher failures. By focusing on near-miss trajectories rather than discarding unsuccessful trials, the method addresses the signal sparsity found in benchmarks like τ 2-bench, where 57% of teacher attempts fail.