UID-Conj. Improves SLM Self-Improvement via Auxiliary Rewards
November 2, 2026
The UID-Conj. metric, combining global entropy variation and local smoothness, improves small-language-model self-improvement by distinguishing reasoning traces. Online experiments on Qwen3-1.7B showed a 2.08 percentage point improvement in macro-average across adaptation and transfer benchmarks.
HOW THIS AFFECTS YOU
●
researcherYou can use entropy-based auxiliary rewards to better guide the self-improvement of small models.