Physics Benchmark Evaluates Reasoning in 53 Foundation Models
October 14, 2026
A new benchmark using 1,034 PhD-level physics problems shows that high accuracy is concentrated in a few thinking models, while most open-weight models solve fewer than 50% of tasks. Evaluation of Qwen3.5-9B specifically highlights failures in applying domain-specific physical knowledge during multi-step reasoning.
HOW THIS AFFECTS YOU
●
builderAvoid relying on smaller open-weight models for complex scientific reasoning tasks without additional verification.
●
researcherThis sets a high bar for evaluating multi-step mathematical reasoning in LLMs.