Reliability-Uncertainty Self-Distillation for Improved LLM Reasoning

This method improves reasoning by weighting distillation loss using a combination of self-judged reliability and predictive uncertainty. When using the same model as teacher and student, the approach reaches 70.47% accuracy on Qwen3 benchmarks.