Characterizing the Capability Gap Between Small and Frontier Models
October 30, 2026
Small language models (SLMs) lag behind frontier models in terminal tasks across solvability, verification, and confidence. While repeated sampling through test-time compute narrows the solvability gap, SLMs still struggle to identify correct solutions or accurately predict success probability.
HOW THIS AFFECTS YOU
●
builderDo not rely on SLMs for tasks requiring high-confidence verification or self-correction without additional compute.
●
researcherThis framework decomposes the performance gap into distinct axes for more targeted model optimization.