Explanations of Large Language Models Explain Language Representations in the Brain

Gradient-based attribution methods map LLM input importance to fMRI activity, predicting neural responses to auditory narratives more accurately than internal activations in early auditory regions. Conductance analysis demonstrates that early layers align with word-type sensitivity, while later layers capture higher-level linguistic features across the cortex.