Chance-Constrained Fine-tuning Limits Rare LLM Safety Regressions

This method introduces a differentiable majorization of the violation rate to limit the fraction of safety examples that degrade during fine-tuning. Unlike average safety loss methods, this chance-constrained approach prevents rare but severe safety failures in instruction-tuned models.