Internalizing Agent Experience into Diffusion Model Weights via On-Policy Context Distillation

Diffusion On-Policy Context Distillation (D-OPCD) transfers reasoning benefits from agentic harnesses directly into diffusion model weights. By treating agent-refined prompts as privileged context during distillation, the method enables models to retain iterative refinement and workflow orchestration capabilities when conditioned on original, raw text queries.