Clinician use of language models diverges from how the models are evaluated

Analysis of 127,833 clinical queries reveals that real-world utility diverges from standard examination-based benchmarks. While benchmarks focus on medical knowledge, 65% of actual clinician use involves documentation, administration, and knowledge retrieval, with only 3.7% of queries directed toward diagnostic tasks.