Low-Resource Adaptation for Bashkir Using QLoRA and CPT

Researchers developed a Bashkir resource suite including a 46.9M token web corpus. Experiments show that applying QLoRA and Continual Pretraining (CPT) to YandexGPT-5-Lite-8B achieves a macro-F1 of 0.748, significantly outperforming encoder-only models like XLM-R and mBERT.