Multi-Scale Dequant: Eliminating Dequantization Bottleneck via Activation Decomposition for Efficient LLM Inference

Introduces Multi-Scale Dequant (MSD), a quantization framework eliminating dequantization bottleneck in quantized LLM inference on decoupled compute architectures (e.g., Ascend NPUs) by removing weight/KV dequantization overhead.