BASIS-Bench Disentangles Personalization from Stereotyping in Speech LLMs
October 12, 2026
The BASIS-Bench framework evaluates eight speech LLMs across demographic robustness, stereotypical bias, and explicit personalization. Findings indicate that most models fail to distinguish between beneficial demographic tailoring and unprompted stereotypical responses.
HOW THIS AFFECTS YOU
●
researcherYou can use this to measure if your speech models are actually personalizing or just stereotyping.
●
policyThis highlights the risk of demographic bias in voice-based AI agents.