Interface Errors Cause Massive Tool-Call Success Rate Discrepancies
September 4, 2026
Discrepancies between model-emitted tool calls and actual tool execution stem from interface-induced trajectory censoring. Testing on Qwen2.5-Coder shows that server-side parsing errors can reduce reported tool-call rates from 80/100 to 0/100 even when the model produces well-formed calls.
HOW THIS AFFECTS YOU
●
builderYou must verify the parsing and chat template contract between your model and server to avoid false zero-success signals in agent evaluations.