HISA Reduces Sparse Attention Bottlenecks via Hierarchical Indexing

HISA replaces flat token-scan indexers in sparse attention mechanisms with a two-stage hierarchical procedure. By combining block-level coarse filtering with token-level refinement, it eliminates the per-layer bottleneck that grows with context length in models like DeepSeek.