OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agents

OpenWebRL trains visual web agents via online multi-turn reinforcement learning directly on live websites, removing dependence on large curated trajectory datasets that bottleneck open-source agent development. The framework targets long-horizon reasoning and precise visual grounding in dynamic real-world environments, areas where open agents have lagged behind proprietary systems.