Mathematical Equivalence of Predictive Modeling and Entropy Coding

Predictive modeling and compression are mathematically linked through cumulative logarithmic loss. A probabilistic model assigning conditional probabilities to a sequence can be converted into an ideal bit payload using arithmetic coding, where the payload length equals the model's entropy.