Rule-Based Methods Outperform LLM Prompting for Speech Naturalness Simulation

Auditing of LLM-based prompting for voice user simulators shows that prompting is unreliable for inducing natural behaviors like disfluency and interruption. In contrast, rule-based, model-free injection algorithms produce more consistent and naturally distributed speech patterns.