Branching On-Policy Distillation Reduces Token Costs in Agent Tasks
October 12, 2026
Branching On-Policy Distillation (BranchOPD) optimizes student training by selecting informative decision points based on uncertainty and teacher-student disagreement. The method reduces student-generated token costs by up to 31% on WebShop through shared-prefix reuse and protocol-boundary repair.
HOW THIS AFFECTS YOU
●
builderYou can lower training and fine-tuning costs for agentic models by using more efficient trajectory sampling.
●
researcherThis technique improves supervision coverage in on-policy distillation without requiring full independent trajectories.