Don't Look at the Numbers: Visual Anchoring Bias and Layer-wise Representation in VLMs

A study across six VLMs from five architectural families finds embedded numeric anchors on images bias quality judgments with effect sizes (eta^2 0.18-0.77) 2.5x larger than severe image degradation. Layer-wise probing shows anchor classification saturates at layers L12-L34, while quality-predictive layers are deeper (R^2 0.69-0.91), revealing a fundamental representational dissociation. Critical finding for anyone deploying VLMs in quality assessment, medical imaging, or content moderation pipelines.