Fine-tuning YandexGPT using Rejection Sampling and Direct Preference Optimization achieves 87.15% accuracy in targeting specific CEFR proficiency levels. The method utilizes a ruRoBERTa-large regression model to predict continuous complexity scores during training.
HOW THIS AFFECTS YOU
●
builderYou can use similar DPO strategies to build educational tools with specific readability constraints.
●
researcherThe study demonstrates how preference-based optimization can control linguistic complexity.