Gzip as a Language Model: Compression Efficiency Scores Text Predictions

Text continuation can be scored by measuring how efficiently gzip compresses candidate outputs appended to a prompt, effectively using compression ratio as a probability proxy. The approach has no learned parameters and serves as a baseline for understanding what statistical patterns LLMs capture.