ARC 3 Scores on Demonstration Set Do Not Reflect Benchmark Reality
August 14, 2026
Scores achieved on the public ARC 3 demonstration set are not indicative of actual performance on the private evaluation set. The private set is designed to be significantly more difficult and novel than the demonstration games.
HOW THIS AFFECTS YOU
●
researcherDo not use public demonstration scores as a proxy for actual reasoning capabilities on the true benchmark.