Verbalized Confidence Outperforms Log-Probabilities for Post-2025 LLM-as-a-Judge

For post-2025 proprietary models, verbalized confidence serves as a more robust soft-scoring mechanism than log-probabilities for LLM-as-a-judge tasks. Integrating an overconfidence advisory and self-debate further improves calibration and robustness across benchmarks like SummEval and HelpSteer2.