Monolingual LLMs Develop Alignable Representations Without Joint Training
August 28, 2026
Monolingual models trained on non-parallel data develop alignable representational geometries that can be mapped via a single Procrustes rotation. This alignment strengthens with increased scale and linguistic proximity, allowing functional content to be transferred between independent models through residual patching.
HOW THIS AFFECTS YOU
●
researcherYou can align disparate monolingual models using rotation-based mapping without needing expensive joint training datasets.