The vLLM inference runtime now supports Beam 1.0 on AMD ROCm platforms. This update extends high-performance inference capabilities to AMD hardware users.
HOW THIS AFFECTS YOU
●
builderYou can now deploy beam search inference workloads on AMD hardware using vLLM.