Search papers, labs, and topics across Lattice.
This paper investigates gender stereotypes in LLMs by probing their responses to French patient records incorporating various Social Determinants of Health (SDoH). They found that LLMs exhibit gender bias when reasoning about patient scenarios, relying on embedded stereotypes to make gendered decisions based on SDoH inputs. The study highlights the importance of evaluating interactions among SDoH factors to better assess LLM bias, especially in healthcare contexts.
LLMs exhibit gender bias in healthcare scenarios by relying on stereotypes when reasoning about patient records, revealing the need to evaluate interactions among social determinants of health to assess LLM performance and bias.
Large Language Models (LLMs) excel in Natural Language Processing (NLP) tasks, but they often propagate biases embedded in their training data, which is potentially impactful in sensitive domains like healthcare. While existing benchmarks evaluate biases related to individual social determinants of health (SDoH) such as gender or ethnicity, they often overlook interactions between these factors and lack context-specific assessments. This study investigates bias in LLMs by probing the relationships between gender and other SDoH in French patient records. Through a series of experiments, we found that embedded stereotypes can be probed using SDoH input and that LLMs rely on embedded stereotypes to make gendered decisions, suggesting that evaluating interactions among SDoH factors could usefully complement existing approaches to assessing LLM performance and bias.
