CogArena: A Multimethod Evaluation of Cognitive Ability Structure in Large Language Models

CogArena provides a 13-paradigm benchmark to evaluate whether LLM cognitive scores represent stable, dimensional abilities. Testing 55 open-weight models shows a single axis explains roughly 50% of variance across tasks. Targeted scaffolding offers minimal within-grouping advantages and fails to improve prediction across different model families after multiplicity correction.