VFold Symmetry-Aware Value Cache Compression for LLMs
October 9, 2026
VFold reduces LLM KV cache memory usage by exploiting inter-layer symmetries without requiring architectural changes. This strategy can be composed with existing quantization and key cache pruning techniques to achieve higher compression ratios with minimal overhead.
HOW THIS AFFECTS YOU
●
builderYou can scale long-context window capabilities on existing hardware by reducing memory bottlenecks.
●
researcherThis provides a method to utilize underused capacity in the value cache through symmetry-aware merging.