Evaluating Perspectival Biases in Cross-Modal Retrieval

The 3XCM benchmark quantifies perspectival biases in cross-modal retrieval, where linguistic prevalence and cultural associations override semantic alignment. Findings show image-to-text models favor high-resource languages over semantic accuracy, while text-to-image models exhibit a "tugging effect" where low-resource queries drift toward culturally familiar visual patterns in the joint embedding space.