LLM Attribution Driven by Q+A Cache Rather Than Document Context
October 26, 2026
Intervening on the KV cache reveals that 7B-32B models attribute answers based on question-and-answer tokens rather than supplied documents. Steering Q+A values along fitted directions can reverse source reporting by 98.9-100% in smaller models, suggesting internal attribution is tied to conversational history.
HOW THIS AFFECTS YOU
●
researcherYou can use these findings to better understand why models hallucinate sources or misattribute context during RAG tasks.