Search papers, labs, and topics across Lattice.
This study investigates how variations in answer formats influence the measurement of gender bias in large language models (LLMs) using three instruction-tuned models evaluated on the BBQ benchmark and OpinionQA survey data. The results reveal that different answer formats鈥攃losed-ended, Likert-scaled, and open-ended鈥攕ignificantly affect bias measurement and can even reverse order rankings in bias assessments. By demonstrating that each format elicits distinct response behaviors, the research underscores the necessity of considering answer format as a critical factor in LLM evaluations to enhance alignment with human response distributions.
Answer format can dramatically alter gender bias measurements in LLMs, sometimes reversing bias rankings entirely.
Gender bias or other social biases in large language models (LLMs) are frequently evaluated with question answering or survey benchmarks where the LLM needs to give a response in a predefined answer format. It is well known in survey science that the answer format has a substantial impact on answers, just as LLMs are sensitive to the prompt wording. However, to our knowledge it has not been studied yet how changes in answer format impact the measurement of gender bias in LLMs and their alignment with human response distributions. We evaluate three instruction-tuned models on the BBQ benchmark and OpinionQA survey data across closed-ended, Likert-scaled and open-ended formats, comparing bias measurement and distributional alignment under otherwise identical conditions. We find that answer format does substantially alter measured outcomes, including reversals in order rankings. These differences arise because each format elicits distinct response behaviours, such as forced-choice selection, scale-based distributions and refusal in free-text generation. Our findings highlight the importance of treating answer format as a substantive component of LLM evaluation and motivate multi-format designs for more robust model assessment.
