VLM Verbalized Confidence Fails Under Image Degradation

An evaluation of Qwen2-VL-2B and SmolVLM shows that verbalized confidence in vision-language models is unreliable under image degradation, often staying near 0.90 regardless of accuracy. In contrast, internal token probabilities provide a much more accurate signal for separating correct from incorrect predictions.