ValuSpec Filters Low-Quality Branches in Tree-Based Speculative Decoding
October 23, 2026
ValuSpec is a plug-and-play mechanism that filters low-quality candidate branches from tree-based speculative decoding before target-side verification. It uses transfer-based supervision and a threshold estimated from target model greedy trajectories without requiring parameter training.
HOW THIS AFFECTS YOU
●
builderYou can improve inference efficiency by reducing wasted target-side computation in speculative decoding setups.
●
researcherThis provides a method to align candidate filtering with target model behavior without additional training overhead.