The Omnilingua-AudioMC benchmark evaluates whether multi-turn conversational abilities transfer from text to speech across ten languages. Results show that model performance can diverge significantly when moving from transcript-based to direct speech-based evaluation.
HOW THIS AFFECTS YOU
●
researcherYou cannot assume text-based conversational metrics will accurately predict performance in audio-native interactions.