Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the unintended regional biases in large language models (LLMs) caused by geographic conditioning, revealing that even neutral prompts can lead to significant location leakage in generated outputs. The authors found that state-of-the-art models exhibited up to 793 times more geographic references when exposed to location metadata, indicating a profound influence of user metadata on model behavior. Additionally, the research uncovers a structural conditioning effect where the mere presence of a user profile frame, regardless of specific geographic content, significantly amplifies leakage, highlighting a critical area for improving model robustness and fairness.
Location metadata can amplify geographic biases in LLM outputs by up to 793 times, even when prompts are neutral.
Modern conversational AI systems frequently rely on user metadata to localize responses, yet the unintended regional biases introduced by this hidden context remain poorly understood. In this work, we evaluate location leakage: the phenomenon where a model generates geographic references despite receiving a geographically neutral user prompt. Across both creative writing and open-ended Q&A prompts, even state-of-the-art LLMs systematically favor region-specific outputs when exposed to location metadata, with leakage spiking by up to 793 times above baseline (e.g., from 0.04% to 31.7% for Llama 3.1-8B, and 21.3% and 8.8% for Qwen3-8B and Claude Sonnet 4.6, respectively). Our analysis further shows a novel structural conditioning effect: replacing the injected location with the placeholder "Unknown" still elevates leakage by up to 72 times above baseline, demonstrating that the user profile frame itself, independent of any geographic content, acts as a generative conditioning signal.