JetSpec Hits 9.64x Speedup and 1000 TPS on Single B200 via Parallel Tree Drafting

JetSpec uses causal parallel tree drafting to resolve the quality-cost tradeoff in speculative decoding, generating a causality-preserving draft tree in a single forward pass. It achieves 9.64x end-to-end speedup on MATH-500 and 4.58x on open-ended chat, translating to roughly 1000 tokens per second on a single B200 GPU with CUDA graph and kernel optimizations.