TMPO: Trajectory Matching Policy Optimization for Diverse and Efficient Diffusion Alignment

Trajectory Matching Policy Optimization (TMPO) constrains diffusion model RL alignment to probability distributions over acceptable trajectories, preventing reward hacking-induced mode collapse and visual degradation.