Systematic Audit Reveals Coverage and Task Equity Gaps in Multilingual Benchmarks

A data-driven audit of 51 multilingual benchmarks across 219 languages shows that 36% of evaluated languages appear in only one benchmark. The study identifies a lack of geographic representation in Oceania and Central Asia and reveals that 56% of datasets rely on English-translated instances, introducing significant framing artifacts.