Linking spatial biology and clinical histology via Haiku

Haiku is a tri-modal contrastive learning model aligning multiplexed immunofluorescence spatial proteomics, H&E histology, and clinical metadata in a shared embedding space, trained on 26.7M patches from 3,218 tissue sections across 1,606 patients and 11 organ types. It achieves cross-modal retrieval Recall@50 of 0.611 versus near-zero baselines, supports zero-shot biomarker inference from text-only clinical descriptions, and outperforms unimodal and bimodal competitors on classification and clinical prediction tasks. Computational pathologists and translational researchers bridging spatial omics with routine histology workflows should prioritize evaluating this framework immediately.