StepCOPS for Certified Policy Selection in Post-Training Pipelines

StepCOPS provides a statistical framework for selecting language model policies using an independent proposal split and Holm's step-down procedure. It achieves 96.4% selected-policy coverage across 11 benchmarks, providing a certified lower-tail floor that is 1.5 points higher than standard methods.