H2DF Objective for Calibrated and Controllable Model Unlearning
October 21, 2026
H2DF introduces a calibrated target-band objective for language model unlearning to prevent the utility degradation typical of gradient ascent. By applying pressure only below a data-dependent lower target, it achieves a forget NLL of 1.528 while maintaining high retain utility.
HOW THIS AFFECTS YOU
●
builderThis provides a more stable way to remove specific data from models without destroying general capabilities.
●
researcherThe target-band approach addresses the unbounded loss issues inherent in standard gradient ascent unlearning.