Confidence Signals Fail to Improve Retrieval-Dominated Extractive QA

Evaluation of four 7-9B model families shows that intrinsic sequence-likelihood confidence fails as a control signal for distillation or routing-and-abstention policies. In retrieval-heavy settings, retrieval alone captures up to 99.8% of potential accuracy, leaving little room for confidence-driven improvements.