RGPO Framework Improves LLM Reasoning via Adaptive Rationale Scaffolding

Rationale-Guided Policy Optimization (RGPO) mitigates reward sparsity in reinforcement learning by adaptively using ground-truth rationale information. This allows models to explore trajectories freely while receiving guidance based on their current capabilities.