A scaling law of contextual persistence in human language

Title: A scaling law of contextual persistence in human language Source: arxiv Word arrangement in human language follows a power-law decay where contextual influence diminishes at a rate of approximately 1/d. Analyzing ten diverse corpora using LLM-based perplexity probes, the study found a mean exponent of alpha = 1.04, a pattern absent in genomic, protein, or scrambled control sequences.