Exact Memory Deletion in Language Models via Algebraic Decrement
July 31, 2026
This method enables precise removal of specific records from model memory, testing techniques like algebraic decrement and masked-refit proxies. Experiments on Gemma 3 (1B) show that support-token deletions can reach a median KL of 5.4e-15, making the model indistinguishable from never-ingested baselines.
HOW THIS AFFECTS YOU
●
researcherYou can implement algebraic decrement to achieve near-perfect data unlearning in specific model architectures.
●
policyThis offers a technical path toward complying with the right to be forgotten in large-scale trained models.