MEGA-CDP Benchmark Measures LLM Adherence to Clinical Guidelines
August 28, 2026
The MEGA-CDP benchmark evaluates LLM adherence to clinical decision pathways (CDPs) using a dataset of 42,353 cases derived from 2,274 guidelines. Testing across 16 LLMs shows that current models struggle to maintain pathway consistency in single and multi-turn clinical settings.
HOW THIS AFFECTS YOU
●
researcherYou can use this benchmark to move beyond simple accuracy and evaluate guideline-following behavior.
●
healthThis signals that current LLMs are not yet reliable for autonomous clinical decision support.