Behavior-Preserving KV Cache Compression via KL Divergence

This training-free framework compresses KV caches by retaining tokens that minimize the KL divergence between the compressed-cache logits and the full-cache next-token distribution. The method uses pre-eviction forward statistics to avoid expensive masked forward passes during compression.