Demographic identity locations identified in Mistral-7B attention heads

Analysis of Mistral-7B reveals that demographic identity is primarily encoded in attention heads rather than last-token residuals, with one specific head (L11 H16) showing high fidelity across multiple attributes. The study shows that standard readout methods significantly understate how models represent group identities.