LLM Latent Structures Diverge From Human Cognitive Constructs

Exploratory Factor Analysis reveals that the latent factors driving LLM performance in quantitative reasoning and chemistry do not align with human-interpretable cognitive constructs. Subject-matter experts were unable to assign pedagogical meaning to most LLM-derived factors, suggesting models solve tasks using non-human logic.