K2-Horizon-MoVA-36B Released with 4B Active Parameters
September 3, 2026
The K2-Horizon-MoVA-36B-A4B is a Mixture-of-Experts model utilizing Mixture-of-Values attention that achieves frontier-class reasoning performance while only running 4B active parameters per token.
HOW THIS AFFECTS YOU
●
builderYou can deploy a high-reasoning agent with significantly lower compute requirements than dense 30B models.
●
researcherThe MoVA architecture offers a new way to optimize parameter efficiency in sparse models.