SRCoD Framework for Diagnosing Multimodal Benchmark Shortcuts
October 14, 2026
SRCoD is a structure-response co-calibration framework designed to detect if multimodal benchmarks rely on single-modality shortcuts. It uses modality-conditioned item response modeling to determine if a model is truly performing cross-modal inference or just exploiting answer-option regularities.
HOW THIS AFFECTS YOU
●
researcherYou can use this to audit your evaluation datasets for modality dependence and shortcut vulnerabilities.