Holdout Best-of-N: Unbiased Evaluation and Its Cost

Holdout Best-of-N provides an unbiased estimator for expected judge rewards by using a subset of fresh scores for selection. While using the same scores for both selection and evaluation introduces bias, this method achieves a minimax risk of order sigma^2/sqrt(K) for Gaussian scores without requiring known variance.