Circuit Analysis of Refusal and Sycophancy in Qwen2.5-7B

By splitting computation into reconstruction and transmission circuits, researchers found that refusal behavior in Qwen2.5-7B-Instruct is driven by compact, faithful circuits. In contrast, sycophancy behavior shows different circuit dynamics, suggesting distinct mechanisms for different safety-related traits.