Flat-RLVR Increases LLM Reasoning Sample Diversity via Sharpness-Aware Minimization

Flat-RLVR mitigates distribution sharpening in reinforcement learning with verifiable rewards (RLVR) by seeking flat reward optima during post-training. By incorporating sharpness-aware minimization with GRPO variants, the method improves sample diversity without sacrificing single-attempt reasoning accuracy.