Mistral Large 4 Uses Sparse Attention to Protect Agentic Capabilities
November 3, 2026
Mistral's 1T-parameter MoE model (52B active) uses DeepSeek Sparse Attention to select 2,048 relevant tokens, preventing the loss of agentic performance caused by aggressive KV-cache reduction. The NVFP4-quantized checkpoint fits on four GB300 GPUs.