Apple Uses Decoupled Diffusion Transformers for On-Device Audio

Apple's Siri Expressive Voices use a memory-efficient architecture that converts semantic audio tokens into high-fidelity audio using residual vector quantization. This allows real-time, high-quality speech synthesis to run entirely on the Apple Matrix Coprocessor.