Surprise-Driven Continual Learning Absorbs Falsehoods in LLMs

Surprise-based continual learning methods cause models to absorb lies at rates similar to random selection when updates are based on prediction error. Using Qwen2.5 and Llama-3.2 LoRA adapters, researchers found that while verifier judges can mitigate falsehoods, they often struggle with source-backed truth updates.