Search papers, labs, and topics across Lattice.
This paper conducts the first empirical analysis of advertising content in ChatGPT's user interfaces, employing a sock puppet audit methodology to explore demographic disparities in ad targeting. By deploying 91 sock puppets across various racial and income categories, the study reveals that lower-income users are disproportionately exposed to advertisements, which predominantly promote consumer goods and direct users to specific advertisers. The findings highlight the evolving landscape of LLM advertisements and suggest significant implications for user experience and equity in digital advertising practices.
Lower-income users are targeted with ads more frequently than their higher-income counterparts, revealing a potential bias in LLM advertising strategies.
This paper presents the first empirical study of advertising content being rolled out in the user-facing online interfaces of large language models (LLMs). We systematically examine possible demographic differences in ad content shown to U.S. users of ChatGPT using a sock puppet audit methodology. We create and deploy 91 sock puppets in a 3x3 factorial design, using geolocation cues (account IP proxies and location-signaling prompts) to signal three racial/ethnic groups (Black, Hispanic, and White) and three income terciles (low, medium, and high). We conduct data collection starting in February 2026, collecting over 3,000 advertisements from 186 unique advertisers in response to 335 prompts on a range of realistic user queries. We find that accounts begin receiving ads 14 days after account creation, and that lower-income accounts, regardless of race, are more likely to receive ads. In this first phase of ChatGPT ads, the ads themselves skewed heavily towards consumer goods, directed users to a specific advertiser rather than a particular product, and were clearly separated from the LLM's response text, observations we anticipate will change as ads continue being integrated into LLM chat interfaces. We release a public, searchable archive of all collected advertisements. Finally, we discuss the implications of our findings, and conclude with methodological and theoretical recommendations for future empirical studies of LLM advertisements.
