[arXiv]score: 0.17

LLM-based Probing for Multimodal Primary ICD Category Prediction

June 30, 2026

Using a frozen MedFound-Llama3-8B backbone, researchers evaluated if hidden states could unify clinical narratives and structured EHR variables for ICD-10 prediction. The study tested linear probes across five transformer layers on a MIMIC-IV cohort of 13,645 admissions.

HOW THIS AFFECTS YOU

●

builderYou can leverage frozen medical LLM hidden states as a shared embedding space for multimodal medical classification tasks.

●

researcherThis validates the use of linear probing on transformer layers for specialized medical downstream tasks.

●

healthThis suggests frozen medical LLMs can effectively bridge structured data and clinical notes for diagnostic coding.

read original ↗arxiv.org

← back to feed