Context-Aware Prediction Recycling for Multimodal Speculative Decoding
November 5, 2026
The proposed method improves speculative decoding in vision-language models by using contextual memories that store target predictions under one-, two-, and three-token keys. This reduces aliasing in image-sensitive decoding states compared to single-token indexing.
HOW THIS AFFECTS YOU
●
builderThis technique offers a way to increase the speed of multimodal inference without retraining.
●
researcherThe use of multi-token keys addresses a specific failure mode in multimodal speculative decoding.