NepSEE Benchmark Reveals Tokenizer Failures in Nepali Sentiment Analysis
October 15, 2026
NepSEE provides a double-annotated Nepali sentiment benchmark using 3,189 verified sentences. Testing shows Claude Opus 5.5 outperforms encoders on a five-point scale, while a tokenizer audit reveals that standard Nepali BERT models incorrectly delete non-spacing Devanagari vowel signs and the virama.
HOW THIS AFFECTS YOU
●
builderYou must audit your tokenizer's handling of Devanagari vowel signs to prevent sentiment misclassification.
●
researcherYou should account for tokenizer-induced character loss when evaluating low-resource Indic languages.