SCOPE Improves Agentic RL via Selective Critical-Step Distillation
October 30, 2026
SCOPE implements selective on-policy self-distillation for long-horizon agents, focusing guidance only on specific error steps within a trajectory. Using Qwen2.5-3B on ALFWorld and WebShop, the method achieves 97.7% success by stabilizing updates with a signed teacher-student coefficient.
HOW THIS AFFECTS YOU
●
builderThis provides a more efficient way to train agents for complex, multi-step tasks.
●
researcherYou can use this to reduce noise in trajectory-level reinforcement learning.