Attention Decodes Harmfulness While MLP Writes Refusals in LLMs

Analysis of Qwen, Llama, and Gemma reveals that attention layers capture harmfulness information in early stages, while MLP layers are responsible for generating refusal text. Post-training strengthens MLP refusal mechanisms without reducing the model's ability to recognize harmful inputs.