A new pull request adds an adaptive multi-token prediction (MTP) mode to llama.cpp that dynamically selects MTP depth via a state machine. The update yields 10-15% gains in code generation and up to 50% speed increases when recalling code from the thinking phase.
HOW THIS AFFECTS YOU
●
builderYou can achieve significant inference speedups for coding tasks without manual depth tuning.