Simple self-distillation (SSD) improves Qwen3-30B-Instruct's LiveCodeBench v6 pass@1 from 42.4% to 55.3% by fine-tuning on high-temperature model outputs without external verifiers.
HOW THIS AFFECTS YOU
●
builderThis offers a low-cost method to boost the coding capabilities of open-weight models through supervised fine-tuning.
●
researcherYou can improve code reasoning in various model scales using only the model's own raw outputs.