PEDBench Benchmark for Phonetic Error Detection in Speech Models

PEDBench introduces a new evaluation dataset comprising 2,605 natural, scripted, and synthetic speech error samples to test phonetic error detection. Evaluations of 13 state-of-the-art speech models show they fail to reliably identify fine-grained phoneme-level substitutions and deletions.