Tool-Augmented Models Show Increased Sensitivity to Prompt Wording

Adding tools to LLMs improves accuracy in programmatic tasks but increases the variance in pairwise model comparisons when questions are reworded. The degree of sensitivity is directly correlated with how much the specific wording influences the model's decision to trigger a tool call.