RLDS Replaces Scalar Rewards with Decomposed Subtask Advantages
September 24, 2026
Reinforcement Learning with Decomposed Subtasks (RLDS) addresses reward collapse in multi-turn rollouts by splitting trajectory rewards into per-subtask shares. The Subtask-Decomposed Advantage Estimation (SDAE) method distributes per-token credit based on a fixed taxonomy of skills.
HOW THIS AFFECTS YOU
●
builderThis offers a way to more precisely tune agent behavior for complex, multi-stage workflows.
●
researcherYou can use this to improve training stability in agents performing tasks with sparse, multi-skill requirements.