Multimodal Training Enables Spatial Reasoning in Text-Only Models
November 13, 2026
Multimodal training creates a vision-language axis in hidden-state space that assists text-only reasoning. In Chameleon-7B, ablating this projection reduces BIG-Bench Hard navigate accuracy by 27.6 percentage points while leaving boolean expression accuracy stable. This effect applies to mental rotation, paper folding, and perspective-taking tasks.
HOW THIS AFFECTS YOU
●
researcherYou can use multimodal pre-training to improve spatial reasoning capabilities in models that only receive text at inference time.