AMD Releases Instella-MoE-16B-A3B Mixture-of-Experts Model
July 24, 2026
AMD has released Instella-MoE-16B-A3B, a 16B parameter Mixture-of-Experts model utilizing approximately 3B active parameters per token. The model is now available on Hugging Face for open-source deployment and testing.
HOW THIS AFFECTS YOU
●
builderYou can now benchmark and integrate AMD-supported MoE architectures into your inference pipelines.
●
researcherThis provides a new MoE architecture to evaluate against existing small-scale sparse models.