LeanGRPO Reduces Redundant Recomputation in Diffusion Reinforcement Learning
September 4, 2026
LeanGRPO introduces two recompute-free training schedules for trajectory-logprob diffusion RL by restructuring data-parallel layouts. This method enables the reuse of computation graphs and activations from the rollout phase during the policy update to eliminate mathematical redundancy.
HOW THIS AFFECTS YOU
●
builderImplementing these schedules can reduce training time and compute costs for generative model post-training.
●
researcherYou can optimize diffusion RL training efficiency by leveraging LeanGRPO-Retain to reuse rollout computation graphs.