FLORES+ Expansion Adds Mozambican Bantu Varieties for MT Evaluation
September 15, 2026
Adding Xichangana, Mozambican Nyanja, and Sena to FLORES+ reveals high reference sensitivity in multilingual MT. For NLLB-200, switching from Tsonga to Xichangana references reduces spBLEU by 13.10 points, demonstrating that dialectal variety conflation significantly skews evaluation metrics.
HOW THIS AFFECTS YOU
●
researcherYou should account for dialectal variation in your evaluation sets to avoid misleading benchmark scores.