TwinKV Reduces KV Cache Footprint via Pairwise Key Redundancy

TwinKV is a training-free, attention-free repair pass that identifies redundant information in the KV cache by detecting near-duplicate keys. It improves long-context inference efficiency by recovering orphaned information and managing duplicate tokens without relying on attention magnitude, which shows near-zero correlation with causal importance.