Detectable Only Where It Is Confounded: What Verified Duplication Counts Say About Membership Evidence in Language Models

Using OLMo-2 and Pythia datasets, this study quantifies membership evidence by replacing estimated training data with exact duplication counts. Evaluation of models from 1B to 13B parameters shows a rank correlation of -0.08 between model prediction costs and training exposure, suggesting low memorization signals in ordinary text.