VR-SparseQuant for accurate FP4 quantization on Vera Rubin
November 20, 2026
VR-SparseQuant uses 2:4 sparsity on Vera Rubin hardware to recover accuracy lost during 4-bit activation quantization. The method uses overlapping sparse streams and offline scale-ratio calibration to reduce perplexity on Nemotron-3-Nano-30B-A3B.
HOW THIS AFFECTS YOU
●
builderYou can run larger models at lower costs using FP4 without the usual quality drops.
●
researcherThis method utilizes elementwise 2:4 sparsity to optimize the FP4 value budget during activation quantization.