Diagnosing Skill Utility Shifts Caused by Policy Updates
October 30, 2026
This method identifies how policy updates change the marginal utility of existing agent skills without requiring new training rollouts. By measuring token preference shifts in pre-update contexts, the approach uses advantage estimates to diagnose utility changes via forward passes.
HOW THIS AFFECTS YOU
●
researcherYou can more efficiently diagnose skill degradation or shifts after fine-tuning using existing data.