Beyond the Verdict: Agentic Code Judging with Verifiable Feedback

USACO-JUDGE evaluates model capability to diagnose programming errors by generating verifiable counterexamples instead of relying on binary verdicts. This agentic judging approach uses problem statements and source code to identify specific failure modes, providing the necessary feedback loop for test-time scaling and iterative code revision.