Audio LLM emotion recognition degrades with text-audio incongruence
November 2, 2026
Research shows that when text and audio signals disagree, audio-capable LLMs experience higher error rates in speech emotion recognition. The study validates an incongruence score using a two-component Gaussian mixture across the eNTERFACE'05, MELD, and CMU-MOSEI datasets.
HOW THIS AFFECTS YOU
●
researcherYou should account for modality mismatch when training or evaluating multimodal speech models.