SlimWise: Decoupling Expert Pruning for Efficient MoE Serving

SlimWise is a serving framework that optimizes Mixture-of-Experts (MoE) inference by using the full model during prefill and a pruned model during decoding. This training-free approach allows for a seamless KV cache handoff, minimizing the throughput bottleneck of expert-weight traffic without sacrificing significant accuracy.