Expert Pruning and MXFP4 Quantization for Machine Translation Compression
September 14, 2026
ESTS compresses GPT-OSS-20B models down to 4.186B–7.770B parameters using routing mass and cross-lingual divergence to rank experts. The approach combines recovery-tuning on synthetic data with MXFP4 quantization for the WMT26 translation task.
HOW THIS AFFECTS YOU
●
builderYou can apply routing-informed pruning and MXFP4 quantization to deploy smaller, efficient translation models.
●
researcherThis provides a pipeline for scaling down large MoE models while retaining translation capability.