Multimodal LLMs Exhibit High Gender Bias in Musical Instrument Associations

Evaluations of ten multimodal models using the Symphony-Bias dataset show that 92% of instrument-level outcomes align with existing social-science gender stereotypes. Bias persists across text, vision, and audio modalities, with specific instruments like the harp and drums showing strong gendered associations.