VisDeception Benchmark for VLM Robustness to Misleading Chart Designs
July 28, 2026
VisDeception evaluates Vision-Language Model robustness using 1,600 paired charts that feature deceptive tactics like truncated axes and distorted aspect ratios. This benchmark isolates reasoning errors caused by visual manipulation to assess the reliability of VLMs in automated data analysis.
HOW THIS AFFECTS YOU
●
researcherYou can use this benchmark to quantify how visual deceptions impact the analytical reasoning capabilities of multimodal models.
●
designerThis highlights how visual encoding choices can systematically mislead automated analytical agents.