Fine-tuning the 300M EmbeddingGemma model for one epoch on 208,511 pairs increases Kazakh Belebele recall@1 from 60.8% to 78.0%. The model's performance on the MTEB scale surpasses OpenAI text-embedding-3-large which scored 47.1%.
HOW THIS AFFECTS YOU
●
builderYou can use this small model to get high-quality retrieval for Kazakh text without large compute costs.
●
researcherYou can see how a single epoch of synthetic question training improves small embedders.