The vLLM inference engine now supports Step-5-Preview on AMD ROCm platforms. This integration enables high-performance serving of the model on AMD hardware via the open-source runtime.
HOW THIS AFFECTS YOU
●
builderYou can now deploy Step-5-Preview models using vLLM on AMD hardware.