[arXiv]score: 0.31

EoupCT Framework Mitigates Catastrophic Forgetting During Continual Fine-Tuning

September 28, 2026

EoupCT preserves general-purpose knowledge during continual fine-tuning by estimating unknown pre-training gradients through dynamic pseudo-data generation. This allows for orthogonal gradient projection even when the original pre-training datasets are unavailable.

HOW THIS AFFECTS YOU

●

builderYou can fine-tune models on new, specialized tasks without losing their original general capabilities, even without access to the base training data.

●

researcherThe framework addresses the fundamental limitation of current orthogonal projection methods that require original pre-training gradients.

read original ↗arxiv.org

DAILY DIGEST

you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy

← back to feed