Denoising Diffusion Generative Models Secretly Calculate Attentions

Diffusion models inherently implement attention mechanisms similar to transformer architectures, suggesting attention as a universal principle emergent from general training objectives. This equivalence enables reformulating the diffusion framework into a simplified attention-based algorithm that reduces both training duration and inference-time computational requirements.