The vLLM inference runtime has merged support for NVIDIA Hopper (SM90) architecture. This integration provides a verified signal for the runtime's hardware compatibility.
HOW THIS AFFECTS YOU
●
builderYou can now run vLLM on H100 GPUs to improve inference performance.