The vLLM inference runtime has merged support for Decision 3.0 models (vllm-sr/d3). This update enables high-performance serving for this specific model architecture.
HOW THIS AFFECTS YOU
●
builderYou can now deploy Decision 3.0 models using the vLLM optimized inference engine.