State Tracking Using Frozen LLMs and External Integer Registers
November 20, 2026
A trained selector allows a frozen 0.8B model to track state across 43,687 events by identifying transitions for an external register. While a 27B model only achieved 3/100 accuracy on two-event windows without reasoning, intermediate steps increased accuracy to 96/100.
HOW THIS AFFECTS YOU
●
builderYou can use small, frozen models to handle long event streams if you offload the computation to an external state manager.
●
researcherYou can achieve high-precision state tracking without retraining large models by using a small selector and an external register.