A Measure-Theoretic Analysis of Reasoning: Structural Generalization and Approximation Limits

A theoretical framework formalizes LLM reasoning via optimal transport, using Wasserstein-1 distance to quantify OOD generalization bounds. Key finding: absolute positional encoding breaks shift-invariance, limiting structural generalization. Provides Lipschitz-based approximation bounds for transformer architectures. Relevant to researchers designing architectures for robust reasoning, offering formal grounding for empirically observed OOD failures.