Localizing personalization features in Mixture-of-Experts LLMs
October 14, 2026
This method uses crosscoders on paired activations to identify specific experts in MoE models that encode personalized features. By leveraging the sparse routing of MoE architectures, the approach enables more precise control and understanding of user-centric personalization compared to dense models.
HOW THIS AFFECTS YOU
●
builderThis offers a path toward more controllable and interpretable personalized AI products.
●
researcherYou can use crosscoders to study how sparse routing facilitates concept localization.