Position Bias in Large Audio-Language Models Causes 24% Performance Fluctuations
September 1, 2026
Six LALMs exhibit significant position bias when reasoning over ordered answer choices. Shuffling option order can shift model rankings and cause performance swings of up to 24%, though permutation-based strategies can mitigate these effects.
HOW THIS AFFECTS YOU
●
researcherYou should use permutation-based strategies to ensure evaluation reliability in audio-language tasks.