Outcome-Mass Alignment for Multi-Turn Agent Reinforcement Learning
November 13, 2026
Outcome-Mass Alignment (OMA) addresses objective-mass imbalance and outcome-statistics multiplicity in multi-turn LLM agent training. The method ensures that row-based outcome statistics are calculated over unique source trajectories and controls aggregate objective mass after within-trajectory aggregation.
HOW THIS AFFECTS YOU
●
researcherYou can use this to fix training imbalances in multi-turn RL agents without changing the base optimizer.