Search papers, labs, and topics across Lattice.
This study investigates the nature of stereotype representation in large language models (LLMs) by comparing their responses to free-form stimuli, such as abstract art and Rorschach blots, against human interpretations across five social domains. The findings reveal that while humans exhibit diverse and nuanced first-order responses, LLMs produce homogeneous outputs that lead to exaggerated second-order stereotypes, a phenomenon termed "stereotype hallucination." This discrepancy highlights critical limitations in LLMs' ability to accurately model human cognitive processes related to stereotypes, particularly in novel contexts devoid of established cultural meanings.
LLMs generate stark and homogeneous stereotypes that distort human interpretations, revealing a dangerous "stereotype hallucination" that undermines their predictive validity in novel contexts.
Recent studies argue that LLMs can predict human stereotypical judgments. Yet whether LLMs emulate the cognitive processes underlying human stereotypes, or merely retrieve learned associations to solve prediction tasks, remains unclear. Prior work examines LLMs' stereotypes in either (i) controlled judgment tasks like multiple choice surveys, or (ii) contexts constrained by conventionalized and predictable group biases. Here, we compare the structure of the stereotypes that humans and LLMs exhibit in the interpretation of free-form stimuli, namely abstract art and Rorschach blots, which lack pre-established cultural meanings. We recruit participants across five social domains (gender, partisanship, personality, urbanicity, and lifestyle) and elicit both first-order (direct personal interpretations) and second-order responses (predictions about how members of social groups will interpret the stimuli); we replicate this design with two multimodal models (GPT-4o mini and Llama-3.2-11B-Vision-Instruct). Humans and LLMs differ not only in magnitude but in the qualitative nature of their stereotypes. Human first-order responses display heterogeneity with minimal group structure. When predicting group responses, humans engage in "stereotype exaggeration" by moderately amplifying first-order tendencies while preserving diversity. By contrast, LLMs exhibit homogeneous first-order responses, and yet generate stark second-order stereotypes that neither amplify existing first-order tendencies nor reflect actual human group differences, a process we term "stereotype hallucination." LLMs continued to hallucinate stereotypes even when fine-tuned on the response data of actual participants. These findings suggest significant limitations in the use of LLMs to model and predict human behavior in novel contexts involving diverse interpretations.
Stanford HAI