[arXiv]score: 0.36

Auditing Clinical Hallucination via Acoustic vs. Transcript Analysis

August 28, 2026

Evaluations of seven LLMs on the TAME Pain speech corpus show that models inferring pain scores from transcripts alone perform near chance (AUC 0.489) on uninformative text. This confirms that transcript-based reasoning cannot recover acoustic pain cues, distinguishing between appropriate abstention and confident fabrication.

HOW THIS AFFECTS YOU

●

researcherThis provides a methodology for designing benchmarks that distinguish between model ignorance and genuine capability.

●

policyThis highlights critical safety risks in deploying text-based models for tasks requiring multimodal acoustic understanding.

●

healthDo not rely on text-only LLM analysis for clinical acoustic signals like pain, as the necessary data is stripped during transcription.

read original ↗arxiv.org

DAILY DIGEST

you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy

← back to feed