NVIDIA released a 75B parameter hybrid MoE model using an Iterative Puzzle compression framework. The model reduces active parameters from 12.8B to 9.3B while achieving 2x higher server throughput via interleaved Mamba and Attention layers.
HOW THIS AFFECTS YOU
●
builderYou can deploy more efficient reasoning models with higher throughput on 8x GPU nodes.
●
researcherThe Iterative Puzzle post-training compression provides a new method for optimizing hybrid MoE architectures.