SOLAR Auxiliary Objective Aligns Soft Token Representations Across Languages

SOLAR adds a supervised fine-tuning objective that aligns probability-weighted vocabulary mixture representations across languages using English as a pivot, targeting the point where multilingual models diverge from language-agnostic intermediate representations into language-specific token generation.