[arXiv]score: 0.12
LLMs Use Three Distinct Retrieval Mechanisms for In-Context Entity Binding
May 29, 2026
Across nine models, in-context entity binding relies on a positional mechanism that degrades at middle positions as list length grows, supplemented by a lexical mechanism (retrieving via the bound counterpart) and a reflexive mechanism (direct pointer). The positional mechanism alone is insufficient for complex multi-entity contexts.
cs.CL
HOW THIS AFFECTS YOU
●
builderUnderstanding that positional retrieval degrades in middle positions for long entity lists informs prompt structuring and context window management for RAG and agentic systems.
●
researcherMechanistic decomposition into positional, lexical, and reflexive circuits across nine models provides a concrete framework for studying retrieval failures in transformers.