●builderYou can improve performance for morphologically rich languages by implementing tokenizers that treat infixes as positional tokens rather than standard subwords.
●researcherThe results suggest morphological correctness is a distinct and measurable advantage over simple frequency-based segmentation.