SHIFT Method Improves LLM Unlearning via Lookahead Extrapolation

SHIFT estimates the direction toward an oracle retrained model by shrinking fine-tuned weights toward pre-fine-tuning states and re-learning the retain set. This approach treats the retrained model as a fixed point, outperforming eleven baselines in aggregate score under the OpenUnlearning protocol.