SafeStart Mitigates Safety Degradation in Accelerated MoE Serving
November 5, 2026
Reducing the number of active experts in MoE models to increase speed can increase successful jailbreak rates by up to 18.4 percentage points. SafeStart restores refusal capabilities in MoE serving with minimal accuracy loss, achieving a 15-28% speedup in offline decoding on an RTX A6000.
HOW THIS AFFECTS YOU
●
builderYou can optimize MoE serving speed without significantly compromising the safety guardrails of your deployed models.
●
policyThis highlights a critical security trade-off between inference efficiency and model alignment in MoE systems.