Mechanisms Behind Post-Training Quantization Robustness

Research identifies why pretrained models resist error accumulation during post-training quantization. Findings show that errors introduced by a new layer tend to oppose errors inherited from the previous layer, creating a partial cancellation effect that stabilizes hidden states.