Mathematical Framework for Detecting Benchmark Contamination in LLMs

This research formalizes the detectability of benchmark contamination as a function of the fraction of seen items and behavioral separability. The authors demonstrate that calibration efficacy can predict held-out power curves with R-squared values between 0.83 and 0.98.