LED is a post-training framework for diffusion language models that enables insertion and deletion during sequence refinement. By using longest-common-subsequence alignment for edit supervision during supervised fine-tuning, it overcomes the limitations of replacement-only editing in handling sequence shifts.
HOW THIS AFFECTS YOU
●
builderYou can use this to improve how your diffusion-based text models handle sequence shifts and edits.
●
researcherThis method allows diffusion models to handle missing or extra tokens more effectively than standard replacement strategies.