SparseSpec-L Enables Train-Free Self-Speculative Decoding for Long Context

SparseSpec-L accelerates long-context inference by generating lightweight drafts from the target model using a dynamically sparsified, recallable KV cache. The framework avoids retraining by using per-head attention statistics as importance signals and employs an entropy-based controller to manage speculation length.