vLLM adds FP8 QSA KV cache support for Ampere GPUs
October 13, 2026
vLLM now supports FP8 quantization for the main KV cache on NVIDIA Ampere architectures (sm_80, sm_86). This addition enables higher throughput and reduced memory footprint during inference on older data center hardware.
HOW THIS AFFECTS YOU
●
builderYou can optimize memory usage and increase serving capacity on Ampere-based instances.