GT Bench Evaluates Algorithmic Graph Reasoning in LLMs

GT Bench introduces a benchmark of 24 classical graph problems across 100,000 examples to test multi-step algorithmic reasoning. Results show that LLM accuracy is highly dependent on input representation—such as adjacency lists versus matrices—and varies based on graph density and topology.