StructLens for Analyzing Transformer Representation Organization
October 22, 2026
StructLens uses maximum spanning trees to analyze the holistic structural organization of representations in Transformer residual streams. The framework reveals how tokens maintain local-span organization and how middle layers show the strongest semantic structure.
HOW THIS AFFECTS YOU
●
researcherYou can move beyond attention-based interpretability to study the high-level semantic organization of a model's internal representations.