Soofi S 30B-A3B Hybrid MoE Mamba Foundation Model

This 30B parameter Mixture-of-Experts hybrid Mamba Transformer activates only 3B parameters per token, maintaining near-constant inference cache for long contexts. Pretrained on 27 trillion tokens, it outperforms Olmo 3 32B and Apertus 70B in English and German benchmarks.