MM-SystemOneBias evaluates multimodal decision model reliability
November 20, 2026
The MM-SystemOneBias framework evaluates 13 models across 5,323 instances to measure how presentation changes affect multimodal decisions. Testing shows decision models are more stable under option-label, irrelevant-information, and rating scale interventions.
HOW THIS AFFECTS YOU
●
researcherYou can use this protocol to test if your multimodal models are biased by irrelevant text or image descriptions.
●
policyThis helps you understand how much a model's decision depends on how the data is presented.