[arXiv]score: 0.15

LoHoSearch Benchmark Caps Top Search Agents at 34.74% on 544 Hard Questions

June 12, 2026

LoHoSearch constructs 544 human-verified questions from a 7-million-entity Wikipedia knowledge graph, selecting relations with large search spaces and complex multi-hop structure. The strongest evaluated model scores only 34.74%, and context management strategies add at most 6 percentage points, compared to BrowseComp where top models exceed 90%.

HOW THIS AFFECTS YOU

●

builderIf you're building or evaluating search agents, LoHoSearch exposes a large unsolved capability gap that BrowseComp-level benchmarks no longer reveal.

●

researcherLoHoSearch's KG-automated construction pipeline offers a scalable method for generating super-human-difficulty search benchmarks that resist saturation.

read original ↗arxiv.org

← back to feed