Basalt 0.4.0 adds Qwen 27B with 776 tok/s structured output
November 15, 2026
Basalt 0.4.0 introduces support for the Qwen 27B dense model, achieving 776 tok/s for structured output and 262 tok/s for conversation on a 5090. The update also adds multi-model routing, video support, and a 262K context window.
HOW THIS AFFECTS YOU
●
builderYou can run high-speed structured inference for 27B models on consumer hardware like a 5090.