External models can estimate LLM confidence via RL critic equivalence
October 26, 2026
Research demonstrates that an external model trained on a policy's behavioral traces can estimate confidence as accurately as the policy itself. The study proves that confidence estimation and RL critic training are equivalent when using correctness-based outcomes.
HOW THIS AFFECTS YOU
●
builderYou can implement reliable confidence estimation without requiring access to a model's internal activations.
●
researcherThis establishes a formal link between value function learning and uncertainty quantification.