SelKV Selective KV Cache Merging with Attention Compensation

SelKV uses a soft cosine gate to adaptively merge or drop KV cache tokens based on semantic similarity. It introduces an attention-ratio compensation mechanism to correct softmax imbalances and prevent the representation degradation common in standard token merging.