ACache Enables Efficient KV Cache Reuse for Diffusion LLMs
August 28, 2026
ACache optimizes Diffusion LLM inference by selectively recomputing KV states for critical Anchor Tokens rather than full recomputation. By recomputing only approximately 20% of affix tokens, the method recovers accuracy lost during naive cache reuse in non-autoregressive, bidirectional context modeling.
HOW THIS AFFECTS YOU
●
builderYou can reduce inference latency in Diffusion LLMs by implementing affix-oriented cache reuse for shared text spans.