Mechanistic Analysis of Multilingual Refusal Circuits in MoE

Investigation of the sarvam Indic-multilingual MoE model shows that safety refusal is a late-stage process where a specific mixture-of-experts writer is controlled by an attention opposer. While harm detection is language-invariant in mid-network layers, the refusal writing occurs late in the generation process.