Generative LLMs Outperform Decision Models on MedQA Accuracy
October 30, 2026
Generative LLM configurations achieved 78.32% to 96.86% accuracy on MedQA, surpassing decision models which ranged from 67.71% to 89.08%. Mercury Decide offered a lower mean cost of $0.0069 per 1,000 questions, while Clef Omni achieved a median request duration of 0.291 seconds.
HOW THIS AFFECTS YOU
●
builderYou can optimize for cost using decision models or latency using Clef Omni depending on your MedQA deployment needs.
●
healthHigher accuracy in generative configurations suggests better reliability for medical multiple-choice reasoning tasks.