Conditional Mutual Information Analysis of LLM Response Variety
November 4, 2026
A new entropy-based framework quantifies LLM response variety using conditional mutual information. The method defines three distinct behaviors—arbiter, independent, and neutral—to analyze temperature settings, prompt compression, and knowledge graph interactions.
HOW THIS AFFECTS YOU
●
researcherYou can use these information-theoretic metrics to more precisely tune temperature and analyze model determinism.