Characterizing Local Semantic Geometry in Decoder-Only LLMs
October 23, 2026
Analysis of Gemma 4, Llama 3.2, Qwen 2.5, and Pythia reveals how semantic meaning is structured through local geometry. Two probes—cross-lingual and refinement—distinguish between exact meaning matches, semantic narrowing, and high-probability attribution.
HOW THIS AFFECTS YOU
●
researcherYou can use these geometric probes to study how models refine specificity versus mere elaboration.