LoWAgent Benchmark Evaluates Web Agents in Hindi, Bengali, Urdu, and Amharic
October 21, 2026
LoWAgent provides a new evaluation framework for web agents across five languages, including four low-resource languages. The benchmark consists of 3,000 task instances across six localized websites, revealing significant performance degradation in non-English environments for both open-source and closed-source models.
HOW THIS AFFECTS YOU
●
builderExpect lower reliability when deploying autonomous web agents in markets using these low-resource languages.
●
researcherYou can use this to measure how well your agents generalize to non-English web interfaces.