[arXiv]score: 0.17
Adaptive DHiSparse: Speculative Decoding over a Load-Adaptive KV Hierarchy
October 12, 2026
Adaptive DHiSparse enables speculative decoding over a hierarchical sparse KV cache by managing residency based on real-time load. At 100K context with 128 concurrency, the system achieves 793 tokens/s per GPU using GLM-5.3 and DFlash2, outperforming HiSparse by 1.45x through integrated draft-model retrieval and fused exact recovery.
DAILY DIGEST
you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy