CurvDelta: Preserving General Capabilities During Model Adaptation
November 17, 2026
CurvDelta uses Kronecker-factored approximate curvature (K-FAC) to create a low-curvature parameter space for model updates. This framework, including the low-rank CurvLoRA variant, ensures parameter adaptations leave preservation loss nearly invariant to prevent degrading general capabilities.
HOW THIS AFFECTS YOU
●
builderYou can adapt models to specific tasks without losing their original general intelligence.
●
researcherYou can use K-FAC to analyze local geometry for more stable fine-tuning.