CompPO Algorithm Uses Computation-Conditioned Credit Transport for LLM RL
August 25, 2026
The CompPO algorithm introduces computation-conditioned credit transport (CCT) to align RL credit assignment with the Transformer's internal computation. By parameterizing the causal kernel with a detached statistic of the behavior policy's computation, it moves beyond architecture-agnostic methods like fixed-discount GAE.
HOW THIS AFFECTS YOU
●
researcherThis provides a more mathematically grounded way to assign credit to specific tokens based on the model's actual compute path.