Search papers, labs, and topics across Lattice.
CMU MLAmsterdam University of Applied SciencesKeioShibaura Institute of TechnologyUPennJun 17, 2026arXiv:2606.18649This study investigates gender bias in large language models (LLMs) within a Japanese hiring context, revealing a significant pro-female bias that mirrors findings from Western research. By employing a counterfactual resume design and analyzing responses from five state-of-the-art LLMs, the research identifies candidate names as the primary channel for gender bias, with name removal nearly eliminating the bias effect. Additionally, the study uncovers a critical deployment challenge: a 42% refusal rate in GPT-4o when using privacy filters, complicating name anonymization in recruitment processes.
Pro-female bias in LLM hiring decisions persists even in non-Western contexts, with candidate names being the key driver of this bias.
Large language models (LLMs) are increasingly deployed in hiring workflows, yet most research on gender bias in LLM hiring decisions has focused on English-language, Western-format resumes. This study examines whether pro-female gender bias extends to a Japanese corporate context and evaluates two practical mitigation strategies. Using a counterfactual resume design with 60 Japanese rirekisho-format resumes, 12 name pairs selected on linguistically grounded gender-signal criteria, and five state-of-the-art LLMs (Claude Sonnet 4.6, GPT-4o, DeepSeek-V3, Gemini 2.5 Flash, Llama 3.3 70B), we conducted 43,200 API calls across baseline, prompt instruction, and privacy filter conditions. A crossed random-effects linear mixed model confirms a significant pro-female bias across all five models, replicating Western findings in a non-Western context. A prompt-level gender-neutrality instruction produces no meaningful reduction in bias. A name-reliance analysis formally identifies the candidate name as the primary gender channel: removing the name from the prompt reduces the female effect by nearly its full magnitude. An unexpected incompatibility between the privacy filter and GPT-4o's content safety filter, resulting in a 42% refusal rate, highlights a practical deployment challenge for name anonymization in LLM-assisted recruitment pipelines.
