Reducing Whisper Hallucinations by 92% via Hallucination Space Projection

A training-free, inference-time method reduces Whisper hallucinations by projecting decoder activations away from a hallucination-associated subspace estimated from non-speech data. The always-on projection variant reduces the hallucination rate from 31.31% to 2.44% on non-speech benchmarks.