OPTD Accelerates Diffusion Language Model Decoding via On-Policy Distillation
August 5, 2026
OPTD addresses the drift between teacher supervision and student inference in few-step diffusion language models (dLLMs). It uses consistency-guided adaptive compression to ensure that compressed transitions remain on-policy, preventing errors caused by early parallel token commitments.
HOW THIS AFFECTS YOU
●
builderThis method offers a path to faster, more stable few-step decoding for diffusion-based text generators.
●
researcherYou can mitigate distribution shift in dLLM distillation by using on-policy transition sampling.