LLMs Exhibit Upward Bias in Interpreting Probability Expressions
August 28, 2026
A cross-model evaluation of 19 models shows that while LLMs track human verbal probability benchmarks, they exhibit a systematic upward bias for negative expressions like unlikely and improbable. The term possible shows the highest cross-model disagreement.
HOW THIS AFFECTS YOU
●
researcherYou should account for systematic uncertainty miscalibration when prompting models with verbal probability terms.