[arXiv]score: 0.24

Zero-Shot LLM Failure in Detecting Pediatric Shared Decision-Making

August 18, 2026

Zero-shot prompting with Qwen 2.5 32B failed to effectively detect shared decision-making behaviors in pediatric clinical encounters, achieving a macro kappa of only 0.139. The study suggests that supervised classifiers significantly outperform zero-shot prompting for this specialized clinical task.

HOW THIS AFFECTS YOU

●

researcherDo not rely on zero-shot prompting for high-precision clinical behavior classification.

●

policyBe aware of the reliability gaps when using LLMs to audit clinical communication standards.

●

healthClinical decision-making monitoring requires specialized supervised models rather than general-purpose LLM prompting.

read original ↗arxiv.org

DAILY DIGEST

you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy

← back to feed