Addressing Exploration and Suppression in Rubric-based RL
July 20, 2026
This work identifies two failure modes in rubric-based RL: Unexplored Criteria (UC), where rollouts never satisfy a requirement, and Suppressed Criteria (SC), where learning signals are lost even when criteria are met. The proposed methods aim to improve exploration without introducing the train-inference mismatch caused by external guidance.
HOW THIS AFFECTS YOU
●
researcherThis provides new targets for optimizing RL for open-ended tasks with complex, multi-part rubrics.