Efficiency Trade-offs in Learned Unmasking for Diffusion Language Models

A study of unmasking policies in diffusion language models shows that a 10% reduction in function evaluations (NFE) is required to offset the overhead of policies up to 7.5M parameters. Results indicate that training policies on trajectory-contraction targets improves the speed-accuracy trade-off.