ROBORMBENCH Reveals VLM Reward Model Fragility to Paraphrasing
September 7, 2026
Vision-language reward models used in robotics exhibit instability where semantic paraphrasing of instructions can flip predicted success/failure scores. The ROBORMBENCH dataset contains 2,390 trajectories and 21,673 verified paraphrases to quantify this lack of invariance.
HOW THIS AFFECTS YOU
●
builderYou must implement robust instruction handling if using VLMs to provide feedback for robotic learning loops.
●
researcherYou should account for paraphrase-induced instability when designing VLM-based reward functions.