Extreme Value Theory Explains Best-of-N Sampling Failures
October 15, 2026
Best-of-N sampling success depends on whether correct responses dominate the upper reward tail. Under Gaussian rewards, incorrect responses with high variance can outperform correct ones even with lower mean rewards, leading to reward-hacking-induced degradation.
HOW THIS AFFECTS YOU
●
builderWatch for reward-hacking degradation when using imperfect reward models for sampling-based inference.
●
researcherYou can use extreme value theory to characterize asymptotic regimes in inference-time scaling.