Advancing Quantization for R&R Models with Microscaling Formats
November 16, 2026
MXFP6 and MXFP8 microscaling formats enable high-throughput inference for Recommendation and Ranking models on AMD MI350X architecture. The 6-bit MXFP6 format achieves significant speedups by quantizing both weights and activations through native GEMM kernels while maintaining a Normalized Entropy margin within 0.01% of FP16 baselines.