LLMs Exhibit Human-Like Working Memory Bottlenecks in N-back Tasks

Testing 15 pretrained models from 70M to 14B parameters shows that LLMs suffer from performance declines and lure errors similar to humans. Probing reveals that attention heads often correctly identify the target, suggesting the error stems from content interference rather than attention precision.