ADIndex Reduces Sparse Attention Indexing Latency via Distillation
November 11, 2026
ADIndex targets the indexing bottleneck in DeepSeek Sparse Attention, which can consume over 50% of prefill GPU time. It uses layer-wise calibration and group-level distillation to create adaptive, low-latency indexers for long-context inference.
HOW THIS AFFECTS YOU
●
builderYou can reduce the prefill time spent on long-context attention by optimizing the indexer.
●
researcherYou can use group-level distillation to capture retrieval signals more efficiently across layers.