Search papers, labs, and topics across Lattice.
This paper investigates implicit biases in Large Language Model Recommenders (LLMRecs) related to sensitive user attributes like gender and age. It introduces three prompt-based debiasing strategies designed to mitigate these biases without requiring access to model weights or extensive computation. Experiments across multiple LLMs and datasets demonstrate that instructing the LLM to be fair can improve fairness metrics by up to 74%, although potential over-promotion of specific demographic groups was observed.
You can boost fairness in LLM recommenders by up to 74% simply by prompting them to be fair, but watch out for unintended over-promotion of specific groups.
Large Language Models (LLMs) can infer sensitive attributes such as gender or age from indirect cues like names and pronouns, potentially biasing recommendations. While several debiasing methods exist, they require access to the LLMs' weights, are computationally costly, and cannot be used by lay users. To address this gap, we investigate implicit biases in LLM Recommenders (LLMRecs) and explore whether prompt-based strategies can serve as a lightweight and easy-to-use debiasing approach. We contribute three bias-aware prompting strategies for LLMRecs. To our knowledge, this is the first study on prompt-based debiasing approaches in LLMRecs that focuses on group fairness for users. Our experiments with 3 LLMs, 4 prompt templates, 9 sensitive attribute values, and 2 datasets show that our proposed debiasing approach, which instructs an LLM to be fair, can improve fairness by up to 74% while retaining comparable effectiveness, but might overpromote specific demographic groups in some cases.
