Soft Prompting and Chain-of-Thought Reduce Language Switching Errors in Multilingual ASR LLMs

Multimodal LLMs used for ASR frequently output the wrong language even when the spoken language is clear, a failure the authors formally define as language adherence violation. Three mitigations are benchmarked — zero-shot prompting, supervised fine-tuning, and CoT reasoning — with SFT and CoT showing the strongest adherence gains without degrading overall transcription accuracy.