LOLPlay Benchmark Evaluates Real-Time Visual Agents in League of Legends
November 4, 2026
LOLPlay evaluates visual agents using 36 champion-specific tasks involving resource management and combat via screenshots and keyboard/mouse inputs. GPT-6 Astra reached a 25.0% task success rate, though increased reasoning effort failed to improve performance and actually reduced available interaction rounds due to latency.
HOW THIS AFFECTS YOU
●
builderThis highlights the critical trade-off between reasoning depth and real-time execution constraints in visual agents.
●
researcherYou can use this benchmark to test how reasoning latency affects real-time agentic control.