JetBrains Mellum2.1 12B Achieves 1.8x Faster Decoding via MTP
November 1, 2026
The Mellum2.1 12B model utilizes a Multi-Token Prediction (MTP) head to enable speculative decoding. This approach achieves 1.4–1.8x faster decoding with a 90% draft acceptance rate, compatible with vLLM, transformers, and llama.cpp.
HOW THIS AFFECTS YOU
●
builderYou can deploy this model to significantly reduce inference latency using existing MTP-compatible engines.