●builderYou can experiment with the separate MTP model to improve inference throughput if standard MTP heads fail in llama.cpp.
●researcherThe availability of the separate MTP model provides a new architecture to study multi-token prediction efficiency.