Context Poisoning Limits Long-Context Retrieval via Attention Interference

Context poisoning occurs when the attention score of decisive evidence is eclipsed by the growing maximum scores of effective distractors. Theoretical analysis shows that to maintain accuracy, the evidence margin must scale as Omega of the square root of log N relative to the number of distractors.