OPSD improves multi-agent mathematical pass@4 by 20 percentage points
November 13, 2026
On Policy Self Distillation (OPSD) converts multi-agent communication into fine-grained token-level credit. This method improves mathematical pass@4 performance by up to 20.00 percentage points over standard GRPO.
HOW THIS AFFECTS YOU
●
builderThis technique could lead to much more capable multi-agent systems for solving complex math problems.
●
researcherYou can use token-level credit and GRPO to better train multi-agent reinforcement learning systems.