ReTopK Accelerates Long-Context Sparse Attention via Query Similarity

ReTopK is a training-free method that accelerates Top-K sparse attention by reusing historical retrieval decisions. It uses a bounded cache of query-support pairs to identify overlapping attention supports, reducing selector cost from linear to sub-linear relative to context length.