FireRedAudio Uses Decoupled Representations for Unified Audio Understanding and Generation

FireRedAudio utilizes a 9B-parameter LLM with separate continuous input representations to handle both understanding and generation. It employs a dedicated Audio Encoder for recognition and a RedAE-based pathway to provide reconstructible features for speech synthesis via a flow-matching DiT.