Message-Passing Quantization (MPQ) treats post-training quantization as posterior inference over discrete codebooks to preserve soft information across weight blocks. By using vector approximate message passing followed by block coordinate descent, MPQ avoids the local optima common in solvers like GPTQ.
HOW THIS AFFECTS YOU
●
builderThis could allow you to deploy higher-performance models at lower bit-widths with reduced accuracy loss.
●
researcherThe formulation of PTQ as a message-passing problem offers a new theoretical framework for quantization research.