vLLM adds Gemma 4 support with optimized routing kernels
October 26, 2026
vLLM has implemented support for Gemma 4, including a change to skip CUDA-graph padding rows in the routing kernel. This optimization targets improved inference efficiency for the new model architecture.
HOW THIS AFFECTS YOU
●
builderYou can now deploy Gemma 4 with optimized inference performance using vLLM.