S4R Enables Compressed Long-Context KV Caching via Sparse Reconstruction

S4R optimizes long-context LLMs by building low-rank subspaces from selectively sampled tokens and using prompt-aware initialization. This approach reduces the memory overhead of KV caches while avoiding the high compute costs of full-prompt decomposition required by online compression methods.