CP-MoE Mitigates Catastrophic Forgetting in Continual Learning

CP-MoE introduces a consistency-preserving Mixture-of-Experts framework using a transient expert to capture early task-specific updates. This method steers routing toward compatible stable experts to prevent task-specific updates from overwriting existing knowledge.