Bebop: Rejection Sampling Fixes MTP Acceptance Rate Collapse During RL Training

Bebop identifies that Multi-Token Prediction acceptance rates during RL training degrade due to entropy increases, following a negative linear relationship, and proposes rejection sampling recipes to maintain speculative decoding speedups in large-scale RL pipelines. This directly addresses the rollout bottleneck that limits RL training throughput for LLMs.