Direct Diversity Optimization Increases Successful Strategy Coverage in LLM Agents

Direct Diversity Optimization (DDO) improves sequential decision-making in LLM agents by combining Divergence-Tree Collection with a Reference-Relative Target-Odds Objective. DDO achieves superior task success and strategy coverage across BabyAI, BabaIsAI, and WebShop benchmarks compared to standard outcome-based post-training.