New Evaluation Framework Proposes Testing Adaptive Reasoning via ARC-AGI

The authors argue current reasoning benchmarks fail to distinguish between across-task abstraction transfer and within-task hypothesis revision. They propose intervention-oriented evaluations that test how systems respond to controlled changes in task evidence and feedback.