VestigeKV: Zero-Training KV Cache Eviction for Long-Context Models
September 4, 2026
VestigeKV utilizes the 64-dimensional decoupled branch in NoPE-MLA models as a query-independent salience signal for KV cache eviction. This method moves non-essential tokens to a GPU-resident archive without training or quantization, maintaining 1.00 retrieval at 8x compression.
HOW THIS AFFECTS YOU
●
builderYou can implement highly efficient long-context retrieval with zero training overhead or loss in accuracy.
●
researcherThis demonstrates how vestigial RoPE components can be repurposed as effective salience channels for cache management.