Quantization and Scale Impact Uncertainty Signals in VLMs
July 28, 2026
Research on the Qwen2-VL family shows that increasing model scale significantly improves internal uncertainty signals, with error-detection AUROC rising from 0.80 (2B) to 0.98 (7B). However, verbalized confidence does not scale as reliably as internal token probabilities.
HOW THIS AFFECTS YOU
●
builderUse mean token probability as a more reliable confidence signal than the model's own natural language responses.
●
researcherThis quantifies the trade-offs between model scale, quantization, and calibration in vision-language tasks.