VEXMLM: Vocabulary Extension for Ge'ez-Script Languages
July 17, 2026
VEXMLM mitigates subword fragmentation in low-resource African languages by extending XLM-R with 30,000 Ge'ez-script subwords. The method uses a language-specific SentencePiece tokenizer and a two-stage training process involving continued masked language modeling.
HOW THIS AFFECTS YOU
●
researcherApply vocabulary extension and specialized tokenization to improve performance on non-Latin scripts.