[arXiv]score: 0.17

RedVox Benchmark Exposes Safety Gaps in Speech Models Across Five Languages

June 26, 2026

Only 8% of state-of-the-art speech model releases document any multilingual safety analysis. RedVox, a new benchmark covering unsafe and stereotypical requests in English, French, Italian, Spanish, and German using real voices, finds that vulnerabilities worsen in non-English languages and are amplified by spoken input compared to text.

HOW THIS AFFECTS YOU

●

builderIf you deploy speech models in non-English markets, this benchmark quantifies safety degradation you should test for before shipping.

●

researcherRedVox provides a concrete multilingual audio safety benchmark against which to evaluate speech models under naturalistic, non-adversarial conditions.

●

policyThe finding that only 8% of model releases include multilingual safety documentation is a direct signal for disclosure requirements in speech AI governance.

read original ↗arxiv.org

← back to feed