Lexical Reference Frames for Interpreting LM Residual Streams
October 16, 2026
LexFrame approximates a language model's native semantics by reading hidden states through the model's own remaining layers rather than fixed lenses. In tests on SmolLM3-3B and OLMo3-7B, it achieved 0.97 coherence, significantly outperforming fixed-direction methods.
HOW THIS AFFECTS YOU
●
researcherYou can more accurately interpret internal model states by using context-adaptive reference frames instead of static linear probes.