The vLLM project has merged support for end-to-end QK Norm, RoPE, and KV Cache runtime fusion for the Qwen3-30B-A3B model on AMD ROCm. This optimization improves inference throughput and efficiency for this specific architecture on AMD hardware.
HOW THIS AFFECTS YOU
●
builderYou can now achieve higher inference performance for Qwen3 models on AMD hardware.