[arXiv]score: 0.09
In-Context Learning Depends on Online Geometric Untangling of Representations
May 29, 2026
Drawing on neuroscience concepts, this work finds that ICL effectiveness correlates with how well LLMs untangle task-relevant representations in high-dimensional space during inference, without parameter updates. The study uses labels defined by the model's own internal representations to isolate geometric factors from task-specific confounds.
cs.CLcs.LGq-bio.NC
HOW THIS AFFECTS YOU
●
researcherProvides a geometric lens on ICL that complements circuit-level mechanistic interpretability work, potentially useful for predicting when few-shot prompting will succeed or fail on novel tasks.