CoSA Co-designs Sparse Attention Proxies and Kernels for Long-Context Inference

CoSA introduces a training-free method that couples a Kernel-Aware Proxy with an Ordered-Skipping Kernel to improve long-context efficiency. This approach uses the proxy to prescribe KV page visitation orders, reducing accuracy loss compared to traditional binary mask-based sparse attention under tight compute budgets.