TUP: Rank-Based Policy Distillation via Truncated Reweighting

The TUP method improves Best-of-N distillation by removing low-ranked completions from the target support and applying tunable sharpness to the upper tail. This reduces reliance on low-quality samples and allows for offline training using binary cross-entropy with a closed-form normalization.