ClaimScope Benchmark for Auditing Mathematical Claims via Label-Blind Verification
October 16, 2026
ClaimScope introduces a 72-task benchmark for auditing mathematical claims using a label-blind witness checker. In evaluations using Qwen3-8B, the verifier feedback improved the detection of invalid claims to 23/39 accepted counterexamples compared to 15/39 without feedback.
HOW THIS AFFECTS YOU
●
researcherYou can use this benchmark to evaluate how well mathematical agents audit proofs via feedback rather than just direct answer accuracy.