ProgressCompass: Embodied Progress Reward Models Are Lost Without the Right Context

Progress Reward Models (PRMs) fail to accurately estimate progress in long-horizon tasks when relying solely on current observations. ContextProgress-Bench introduces 24 manipulation tasks across 120 episodes to evaluate how much historical context is required for dense reward estimation in embodied agents.