Seeing is Coding: On the Effectiveness of Vision Language Models in Code Understanding

Representing source code as rendered images instead of linear text tokens can reduce computational costs by leveraging the inherent compressibility of the image modality. This approach allows adjusting resolution to scale context length while maintaining semantic recognizability for vision-language models. This study evaluates the feasibility of substituting text-based sequences with visual representations to address scaling bottlenecks.