Cross-Lingual Grammar Circuits Identified via Activation Patching
August 20, 2026
Analysis of 29 languages across five model families reveals that languages with overt person and number inflection share more similar subject-verb agreement circuitry. Using activation patching, the study identifies specific attention heads that causally drive morphosyntactic agreement across different linguistic structures.
HOW THIS AFFECTS YOU
●
researcherYou can better understand how multilingual models generalize grammatical rules by focusing on inflection-heavy language pairs.