Answer Formats Significantly Alter Measured Gender Bias in LLMs

Evaluating three instruction-tuned models on BBQ and OpinionQA shows that switching between closed-ended, Likert-scaled, and open-ended formats causes substantial changes in bias measurements and even reverses order rankings. This indicates that bias benchmarks are highly sensitive to prompt structure rather than just model weights.