Gold vs.~Translation: Are We Measuring Language, Knowledge, or Locality in Translated Benchmarks?

Evaluating translated English benchmarks like MMLU against native datasets shows inconsistent proxy validity across different languages. Testing 29 models across five Nordic and Baltic languages revealed that translated scores provide minimal predictive value for native performance, with the strongest incremental validity found only in curriculum-overlap benchmarks like Skolprov ($\Delta R^2$=.128).