BLiMPPI Multilingual Benchmark for Polarity Item Grammaticality
October 12, 2026
BLiMPPI introduces a multilingual evaluation suite containing over 12,000 negative polarity item (NPI) minimal pairs across 33 languages. The benchmark identifies performance gaps in multilingual models, particularly in lower-resource languages and non-n-gram solvable contexts.
HOW THIS AFFECTS YOU
●
researcherYou can use this suite to evaluate how multilingual models handle syntactic and semantic constraints across diverse languages.