CME-SpectrumBench Evaluates LLM Performance on Condensed Matter Spectral Data

CME-SpectrumBench introduces a 190-question benchmark testing LLM ability to identify structures in 2D intensity arrays from noisy, simulated condensed matter experiments. Current frontier models struggle with dense context reasoning in these tasks compared to handwritten code solutions.