Defining the Information Shadow as a Structural Limit to LLM Learning

The information shadow identifies three categories of phenomena text-trained models cannot acquire: unexpressible language structures, statistically non-identifiable functions, and gradient-unreachable representations. Probes show that text-only learners face an expressibility ceiling that remains even with 300x more data.