Parameter constraint methods fail to prevent forgetting during continual SFT
October 23, 2026
A functional-path analysis shows that constrained supervised fine-tuning (SFT) still causes knowledge loss due to gradient staleness and probe mismatch. Findings indicate that the placement of QLoRA interventions relative to the Adam optimizer significantly affects retention, and a specific 'refresh budget' is required to balance new learning with old task preservation.
HOW THIS AFFECTS YOU
●
builderOptimize fine-tuning pipelines by carefully managing the timing of LoRA interventions and replay data.
●
researcherUse functional-path decomposition to identify why specific fine-tuning trajectories disrupt prior knowledge.