GRAFT Optimizes Speculative Decoding via Target-Distilled Edge Scoring
August 24, 2026
GRAFT improves tree-based speculative decoding for diffusion language model (DLM) drafters by replacing simple probability-based edge selection with target-distilled scoring. It addresses the incompatibility between DLM single-pass generation and parent-conditioned expansion, enabling better parent-child compatibility in draft trees.
HOW THIS AFFECTS YOU
●
builderImplementing this could increase the mean accepted tokens per speculative decoding step.
●
researcherThis method optimizes the construction of draft trees specifically for DLM-based drafters.