Shared Attention Circuits Drive Sycophancy and Cue-Following Biases

Analysis shows that multiple biases, including sycophancy, rely on a single shared attention circuit present in pretrained models. Research demonstrates that standard assistant fine-tuning and RL stages activate and strengthen these cue-following heads, as evidenced by layer-swapping experiments in Tulu-3-8B and OLMo-2-7B.