Search papers, labs, and topics across Lattice.
This paper investigates how ideologically-loaded retrieved documents in RAG pipelines influence LLM outputs, focusing on COVID-19 treatment discourses. They construct a corpus of 1,117 academic articles representing different viewpoints on treatments, analyze it using Lexical Multidimensional Analysis (LMDA) to identify ideological dimensions, and then prompt LLMs with questions and retrieved ideological texts. The results show that LLM responses align more closely with the ideology present in the retrieved texts, especially when prompts include LMDA descriptions of the ideological dimensions, highlighting the susceptibility of RAG systems to ideological manipulation.
RAG systems readily absorb and amplify ideological biases present in retrieved documents, even more so when prompts explicitly describe the ideological dimensions at play.
This paper studies the impact of retrieved ideological texts on the outputs of large language models (LLMs). While interest in understanding ideology in LLMs has recently increased, little attention has been given to this issue in the context of Retrieval-Augmented Generation (RAG). To fill this gap, we design an external knowledge source based on ideological loaded texts about COVID-19 treatments. Our corpus is based on 1,117 academic articles representing discourses about controversial and endorsed treatments for the disease. We propose a corpus linguistics framework, based on Lexical Multidimensional Analysis (LMDA), to identify the ideologies within the corpus. LLMs are tasked to answer questions derived from three identified ideological dimensions, and two types of contextual prompts are adopted: the first comprises the user question and ideological texts; and the second contains the question, ideological texts, and LMDA descriptions. Ideological alignment between reference ideological texts and LLMs' responses is assessed using cosine similarity for lexical and semantic representations. Results demonstrate that LLMs' responses based on ideological retrieved texts are more aligned with the ideology encountered in the external knowledge, with the enhanced prompt further influencing LLMs' outputs. Our findings highlight the importance of identifying ideological discourses within the RAG framework in order to mitigate not just unintended ideological bias, but also the risks of malicious manipulation of such models.
