Multi-Future Drafting for tree-verified speculative decoding
November 11, 2026
Multi-Future Drafting (MFD) improves speculative decoding by using learned mode embeddings to prevent the creation of chimera prefixes. Current tree-verification methods can result in 27-33% of a 64-node tree being composed of incorrect prefixes stitched together from different futures.
HOW THIS AFFECTS YOU
●
builderYou can reduce wasted compute in speculative decoding by avoiding the generation of non-existent token prefixes.
●
researcherThis identifies a specific failure mode in product-ranked tree verification where the chain rule misallocates probability mass.