Spec-AUF Reduces Train-Inference Misalignment in Block Drafters

Spec-AUF addresses the mismatch in speculative decoding where block drafters are trained on full-block cross-entropy but only verified up to the first failure during inference. By restricting the loss support to the accepted prefix, this single change to the loss function optimizes drafters for real-world verification patterns.