Verification-Aware Training Improves Speculative Decoding Speed
August 30, 2026
Verification-Aware Training (VAT) is a plugin framework that optimizes speculative decoding by incorporating the sequential rejection patterns of the target model into the draft model's training. It uses a lightweight binary classifier to supervise the draft model on which token positions are likely to survive verification.
HOW THIS AFFECTS YOU
●
builderYou can use VAT to increase the efficiency and speed of LLM inference by better aligning draft models with target verifiers.