Cross-Modal Retrieval Heads in Multimodal Large Language Models

Analysis of 18 language and vision-language checkpoints shows that retrieval heads—sparse attention heads used for evidence location—are largely shared across modalities. This mechanism persists even when adding audio-visual inputs, suggesting a unified architectural pattern for cross-modal information transfer.