Predicting Privileged Information Effectiveness for On-Policy Self-Distillation

Evaluating 16 privileged information (PI) configurations across three multi-turn agentic benchmarks shows that PI effectiveness depends on content density and generator capability. Results demonstrate that information-dense trajectories and PI from higher-capacity models improve student performance during on-policy self-distillation, regardless of student scale or reasoning mode.