ADMM-Q: An Improved Hessian-based Weight Quantizer for Post-Training Quantization of Large Language Models

ADMM-Q introduces a combinatorial ADMM-based post-training quantization algorithm targeting layer-wise weight quantization in LLMs, aiming to outperform GPTQ and RTN at sub-4-bit precision where those methods degrade significantly. The Hessian-guided optimization framework addresses the combinatorial structure of quantization directly. Practitioners compressing large models for edge or inference-cost reduction should evaluate this against GPTQ baselines.