●builderIf you are fine-tuning LLMs sequentially on new tasks, SAE-guided activation regularization is a drop-in alternative to EWC that avoids replay buffers and better preserves pretrained knowledge.
●researcherThe theoretical derivation showing EWC as a special case of the SAE-regularized objective gives a principled basis for comparing continual learning methods on LLMs.