Kullback-Leibler Divergence is an Incomplete Metric for Quantization Quality

Using static text datasets to calculate KLD between base and quantized models fails to account for the shifting probability distributions present during autoregressive generation. Reliable quantization evaluation requires datasets that mirror the model's own generated context during inference.