Auditing Audio Language Models for Paralinguistic Reliability

Counterfactual audits reveal that audio-language models (ALMs) often fail to utilize paralinguistic cues like prosody or affect, relying instead on lexical content. Evaluations across Gemini and GPT show that aggregate accuracy metrics often mask fundamental failures in tracking audio-specific cues.