Instability in Difficulty Labels Impacts RLVR Reasoning Research

A study of Reinforcement Learning with Verifiable Rewards (RLVR) finds that perceived unlearnability in difficult prompts is often caused by unstable difficulty labels rather than inherent model limitations. Difficulty-defined sets based on limited sampling are non-reproducible and significantly affect gradient-similarity conclusions.