Diagnostic Ladder Exposes False Tool-Use Claims in Small Models

A new diagnostic ladder reveals that small language models can score highly on keyword-based tool-use benchmarks through simple verbatim reproduction without actual generalization. The study shows a 661M parameter model mimicking a 1B parameter model on lenient metrics despite failing actual functional tests.