LLM Reasoning Performance Collapses Beyond Depth 10 in ProloNg Benchmark

The ProloNg testbed reveals that frontier LLMs struggle with long-horizon deductive logic using Prolog, with reasoning depth up to 22 and 62k context lengths. Most evaluated models approach chance levels once reasoning depth exceeds 10, regardless of total context window size.