Encoder-Free Multimodal LLMs Develop Implicit Audio and Visual Encoders

Analysis of Gemma-4 12B and Inkling-Small shows that transformer layers learn implicit encoders when fed raw pixels or spectral features without modality-specific encoders. These early layers process audio and visual inputs in a manner largely invariant to cross-modal context.