Mechanistic Decomposition of Syntax and Surface Language in mLLMs
September 2, 2026
Causal interventions reveal that multilingual LLMs decompose translation into modular stages: conceptual representation, target-side word-order construction, and surface language production. This research demonstrates that syntax and language realization are separable processes within the model architecture.
HOW THIS AFFECTS YOU
●
researcherThis provides a more granular mechanistic understanding of how multilingual models decouple semantic content from syntactic structure.