Interventions on Qwen3.5 and Falcon-H1 reveal that attention mechanisms handle exact retrieval while recurrent states control output language and persona. State-swap experiments show that switching KV caches and recurrent states separates these two functional channels.
HOW THIS AFFECTS YOU
●
researcherYou can target specific model behaviors by manipulating the attention or recurrent components independently.