Interrogating Multimodal Diffusion Transformers via LLM Bottlenecks

A lightweight bottleneck network can map intermediate multimodal attention tokens from Diffusion Transformers into a frozen LLM's input space. This allows an LLM to answer natural language questions about emerging image semantics and fine-grained details directly from hidden representations.