FreqDepthKV Reduces KV Cache Size for Long-Context Inference

FreqDepthKV compresses KV caches by factorizing adjacent-layer states into shared low-frequency depth components and sparse high-frequency residuals. An online probe selects compression modes per attention head, maintaining high accuracy in needle retrieval and summarization benchmarks.