Qwenfant: Character-Level BabyLM Training with Synthetic Data

Qwenfant utilizes character-level vocabularies and LoRA-style fine-tuning on synthetic, LLM-summarized parallel text to improve small model performance. The approach achieved first place in the Multilingual track of the 2026 BabyLM Challenge.