SPARE: Efficient MoE Pruning via Routing Entropy

SPARE is a training-free method for Mixture-of-Experts (MoE) architectures that allocates sparsity by analyzing the entropy of Top-K gate weights. By pruning layers with more diffuse routing more aggressively, it improves accuracy over uniform expert pruning without requiring retraining or selector-specific knowledge.