vLLM adds thinking_token_budget to Model Runner V2
August 6, 2026
vLLM now supports a thinking_token_budget parameter in its Model Runner V2 architecture. This allows for explicit control over the number of reasoning tokens generated during inference.
HOW THIS AFFECTS YOU
●
builderYou can now better manage latency and cost by capping the computational budget for reasoning-heavy models.