MDraft Improves Diffusion Drafter Performance via Multi-Draft On-Policy Distillation
October 30, 2026
Parallel speculative decoding with one-step diffusion drafters suffers from mismatched verifier targets due to token dependency issues. MDraft introduces a new distillation method that addresses this mismatch, preventing the suppression of plausible tokens during the parallel drafting process.
HOW THIS AFFECTS YOU
●
builderThis technique can reduce inference latency in speculative decoding pipelines for diffusion models.
●
researcherThe method provides a solution to the training-inference mismatch inherent in parallel drafting architectures.