Directional Asymmetry in Multilingual Weight-Space Model Merging
September 4, 2026
Weight-space merging for multilingual translation shows strong directional asymmetry. Merging is more effective when models share a target language, but performance drops sharply in shared-source or bidirectional consolidation settings compared to language-specific checkpoints.
HOW THIS AFFECTS YOU
●
builderExpect performance degradation when attempting to merge models with different target languages.
●
researcherYou should account for directional asymmetry when designing merging strategies for multilingual tasks.