CallBench Benchmark for Dual-Goal Phone Call Assistants
July 28, 2026
CallBench is a Chinese-language benchmark containing 50,000 multi-turn dialogues designed to evaluate phone call assistants. It specifically tests the ability of models to coordinate a device owner's preset goals with a caller's dynamic, often conflicting, implicit goals across six real-world scenarios.
HOW THIS AFFECTS YOU
●
builderYou can use this to benchmark how well your voice agents handle goal conflicts and emergent user intents.
●
researcherThis provides a more realistic evaluation framework for agents operating in complex, multi-agent environments.