SCALPEL: Selective Unlearning via Contrastive Sparse Autoencoders

SCALPEL utilizes contrastive sparse autoencoders to perform selective representation-level unlearning on Qwen, Llama, and Gemma models. This method addresses the energy bias in standard reconstruction-based extractors, allowing for the removal of specific target information while minimizing perturbations to the model's general knowledge.