Few Channels Draw The Whole Picture: Revealing Massive Activations in Diffusion Transformers

Study identifies sparse massive activations in Diffusion Transformers where a small subset of hidden-state channels drive image generation; shows these channels are functionally critical for semantic control despite comprising only a fraction of total activations.