Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study examines how large language models (LLMs) generate varying medical triage recommendations based on the language of patient prompts, using Gemini 3.5 Flash to analyze responses to a neurological symptom profile across six languages. The findings reveal significant disparities in emergency room visit recommendations, with rates as low as 0% for non-English prompts compared to 30% for English, despite consistent severity scores across languages. Notably, the introduction of a patient's U.S. location dramatically increased ER recommendations for non-English prompts, highlighting the influence of implicit geographic inference in LLM outputs.
Language can dramatically skew emergency medical recommendations, with LLMs showing up to a 76.7 percentage point difference based on geographic context.
We investigate whether large language models produce different medical triage recommendations for identical symptoms based solely on the language of the patient prompt. Using Gemini 3.5 Flash, we evaluate a neurological symptom profile (persistent headache, blurred vision, nausea) across six languages (English, Spanish, Chinese, Hindi, Japanese, Arabic) with 30 runs per condition (n=450 total API calls). We find that the model recommends emergency room visits at rates ranging from 0% (Japanese, Hindi) to 30% (English, Arabic), despite assigning nearly identical severity scores (7.7-8.0/10) across all languages. Adding a single sentence specifying the patient's US location increases ER recommendations by up to 76.7 percentage points for non-English prompts, while the reverse anchor (English prompt with a Tokyo location) reduces the ER rate from 30% to 6.7%. A back-translation control (Japanese to English) produces ER rates comparable to the English baseline, confirming that the disparity is not caused by translation quality but by implicit geographic inference from the input language. We release the complete dataset, experiment code, and results.