RoPERelay: Maintaining Positional Geometry in Sparse KV Caches
October 16, 2026
RoPERelay reorganizes RoPE coordinates for sparse KV caches to prevent gaps from evicted tokens from disrupting query-key matching. It uses inverse and re-rotation to assign compact, order-preserving coordinates without requiring additional cache budget or re-prefill.
HOW THIS AFFECTS YOU
●
builderYou can improve long-context inference quality in sparse attention systems without increasing memory overhead.
●
researcherThis addresses the geometric degradation caused by token eviction in rotary positional embeddings.