Prompt Interference in LLM Post-Training: Why Pass@k Optimization Can Degrade Pass@1

Directly optimizing for Pass@k during post-training can degrade Pass@1 performance due to gradient conflicts caused by prompt interference. This phenomenon occurs when shared model parameters couple the probability distributions of diverse samples, forcing a trade-off between multi-sample success and single-shot reliability.