From RL Papers to Framework Code: Inclusion and Review in Seven Open-Source Training Frameworks

Analysis of seven open-source reinforcement learning frameworks reveals that only 2.3% of 1,598 general RL training papers were implemented in code. Implementation rates remained stagnant at 5 to 7 methods per cohort despite increasing paper volume, with a significant bias toward methods targeting policies of 30B parameters or larger.