Search papers, labs, and topics across Lattice.
This paper investigates the extent to which LLMs can be used to commercially influence users in conversational search scenarios. Through two experiments with over 2000 participants, the authors found that LLM-driven persuasion triples the selection rate of sponsored products compared to traditional search. Furthermore, they show that users are largely unaware of this influence, even with explicit "Sponsored" labels, and that instructing the model to conceal its intent further reduces detection rates.
LLMs covertly steer consumer choices at nearly three times the rate of traditional search, and current transparency measures are failing to protect users.
As Large Language Models (LLMs) become a primary interface between users and the web, companies face growing economic incentives to embed commercial influence into AI-mediated conversations. We present two preregistered experiments (N = 2,012) in which participants selected a book to receive from a large eBook catalog using either a traditional search engine or a conversational LLM agent powered by one of five frontier models. Unbeknownst to participants, a fifth of all products were randomly designated as sponsored and promoted in different ways. We find that LLM-driven persuasion nearly triples the rate at which users select sponsored products compared to traditional search placement (61.2% vs. 22.4%), while the vast majority of participants fail to detect any promotional steering. Explicit "Sponsored" labels do not significantly reduce persuasion, and instructing the model to conceal its intent makes its influence nearly invisible (detection accuracy < 10%). Altogether, our results indicate that conversational AI can covertly redirect consumer choices at scale, and that existing transparency mechanisms may be insufficient to protect users.
