Heavy-Tailed Memory Traces in Long-Horizon Language Agents

Memory traces in long-horizon agents follow heavy-tailed distributions, where semantic LLM policies concentrate retrieval on a small core and leave rare states in a long tail. The proposed Core-Tail World Model (CTWM) uses a rank-based controller with a single exponent $\tau$ to manage prompt budgets while retaining summarized tail states.