DStill Distillation Enables One-Step Drafting in Block Diffusion Speculative Decoding
October 21, 2026
DStill is a two-stage framework that distills multi-step iterative refinement trajectories into a single-step drafter. This method addresses token factorization errors in discrete diffusion, allowing for faster speculative decoding without the latency penalty of iterative refinement passes.
HOW THIS AFFECTS YOU
●
builderYou can reduce inference latency in speculative decoding by using a single-step distilled drafter.
●
researcherThe framework provides a way to bridge the gap between draft fidelity and inference speed in diffusion models.