INT4 quantization increases proactive interference failure in LLMs

Post-training quantization via bitsandbytes significantly degrades a model's ability to manage overwritten values in memory. In Qwen2.5-7B-Instruct, INT4 quantization reduced retrieval accuracy from 81.0% to 68.3% under high interference conditions.