Fine-Tuning Can Revert Behavior Without Removing Weight-Embedded Steering

Research shows that while fine-tuning can undo the behavioral effects of embedded activation steering—such as refusal suppression—the underlying weight edits often remain intact. In studies of 3B-14B models, the mean vector recovery was near-zero, indicating that optimization pressure can override steering without erasing the mechanistic edit.