Qwen3 Tajik Adaptation Shows Loss Reduction Does Not Equal Comprehension
November 5, 2026
LoRA adapters for Qwen3 (0.6B to 8B) reduced Tajik text loss by 0.60 to 1.45 nats per token without improving Belebele reading comprehension scores. Significant gains of 11.4 points on Belebele required continued pretraining on 375 million tokens followed by supervised fine-tuning.
HOW THIS AFFECTS YOU
●
researcherYou should prioritize continued pretraining over simple LoRA fine-tuning for low-resource language adaptation.