Label-Free Abstention via Model Confidence Signals
August 28, 2026
Fine-tuning small LLMs (1B-8B) using LoRA on internal confidence scores allows models to abstain from uncertain answers without requiring ground-truth labels. At matched coverage, this label-free method performs comparably to supervised abstention-tuning.
HOW THIS AFFECTS YOU
●
builderYou can implement uncertainty-aware responses in your applications without the cost of maintaining error-labeled datasets.
●
researcherYou can explore using frozen confidence signals as a proxy for correctness in model calibration.