Can LLMs Improve Their Own Harness? A Controlled Study on ARC-AGI-3

Frontier models were tested on their ability to autonomously construct and iteratively refine symbolic task harnesses for the ARC-AGI-3 benchmark. Using a fixed coding bootstrap, agents developed complete codebases to manage perception and tool use across five development games, with performance evaluated on twenty unseen environments after two revision cycles.