Cross-Script Entity Matching Failures in Multilingual Language Models
October 23, 2026
Multilingual LLMs show significant identity judgment discrepancies when names switch scripts, such as Qwen2.5-7B's accuracy dropping from 35.1% in Latin to 8.5% in Devanagari. The study finds that reduced tokenization fragmentation does not resolve these performance gaps across different language families.
HOW THIS AFFECTS YOU
●
researcherYou should investigate script-specific tokenization biases in multilingual model evaluation.
●
policyYou must account for significant reliability gaps in identity-related tasks when deploying models in non-Latin script regions.