Curation-Bench Tests Whether Agents Can Replace Human Data Curation

Curation-Bench is a benchmark where agents get CLI access to inspect data, implement selection policies, and iterate against a fixed training/eval pipeline. Out-of-the-box coding agents match strong published data-selection baselines within 10 iterations, but trajectory analysis shows agents mostly tune existing heuristics rather than discovering novel policies.