Transformer depth enables exponential increase in graph search reachability
November 11, 2026
A two-layer transformer is both necessary and sufficient to implement near-linear DFS reasoning on dense graphs. For models with k layers where k is at least 3, the reachability horizon for a bounded-reachability DFS policy increases exponentially at 1 + 2^(k-3).
HOW THIS AFFECTS YOU
●
researcherThis provides a formal proof for why increasing transformer depth improves complex symbolic reasoning capabilities.