OCGQuant Post-Training Quantization for NVFP4 Accuracy
September 2, 2026
OCGQuant addresses Collateral Quantization Error in NVFP4 formats by adaptively pairing outlier channels with low-magnitude neighbors within a quantization block. This grouping strategy reduces the error caused by large activations dominating the block scale without the computational overhead of mixed-precision methods.
HOW THIS AFFECTS YOU
●
builderYou can achieve higher inference accuracy on low-bit hardware by using outlier-companion grouping.
●
researcherThis provides a new way to optimize microscaling formats via channel-grouping instead of rotation.