Users defer to confident LLM falsehoods in human-AI trust experiments
October 23, 2026
An experiment using GPT-5-mini reveals that users significantly defer to incorrect but confident AI assistants, with correct answers falling from 7.4 to 2.9 out of 10. When an assistant presented plausible falsehoods with high confidence, users chose the planted error 60% of the time, indicating a collapse in trust calibration.
HOW THIS AFFECTS YOU
●
researcherStudy the intersection of model confidence and user susceptibility to sycophancy.
●
policyThe tendency for humans to defer to confident, incorrect AI poses significant risks for automated decision-making systems.