Search papers, labs, and topics across Lattice.
This study analyzes the structural concentration of AI bias research, revealing that a small number of countries, institutions, and authors dominate the field, particularly in the general fairness and bias mitigation domains. By examining 692 publications through bibliometric analysis and semantic clustering, the authors highlight that the United States leads in both publication output and collaboration networks, while low- and middle-income countries are largely excluded. The findings raise critical concerns about the generalizability of bias mitigation methods, as they are primarily shaped by a narrow set of contexts, potentially undermining their effectiveness in diverse applications.
The dominance of a few countries and institutions in AI bias research risks creating a narrow lens through which fairness is defined and addressed.
Artificial intelligence increasingly mediates consequential decisions in healthcare, law, and public services, and the field has responded with an extensive methodology for measuring and mitigating bias. Yet the fairness definitions, benchmarks, and debiasing frameworks on which this methodology rests are treated as universal while being produced by a research community whose composition has never been characterized. We show that the AI bias research are structurally concentrated, and that this concentration is greatest, geographically, in precisely the domain the rest of the field inherits from. Analyzing 692 publications spanning five thematic domains, combining bibliometric analysis with semantic clustering, we find that research activity is dominated by a small set of countries, institutions, and authors, with the United States leading publication output and collaboration networks across every domain and most strongly in general fairness and bias mitigation, the largest, most-cited domain with meaningful representation across all four semantic clusters. Low- and middle-income countries remain largely absent from the community and its collaboration networks, and citation influence is highly skewed (median = 9; mean =93.5 ), indicating that a small fraction of publications disproportionately shapes the field. Because the general-fairness domain supplies the definitions and benchmarks that application areas apply, concentration of research effort in this foundational domain propagates across AI bias research as a whole - raising the concern that mitigation methods developed and validated within a narrow set of contexts may not generalize to all populations and settings where AI is deployed. We provide an interactive atlas for continuous monitoring of the field's structure.
MIT CSAIL