Search papers, labs, and topics across Lattice.
This study conducts a thorough analysis of demographic biases in the LAION-5B dataset, focusing on age, gender, race, and emotion through the application of advanced models such as FairFace, DeepFace, and Emo-AffectNet. The results reveal significant overrepresentation of young adults, White individuals, and males, alongside a troubling underrepresentation of minority groups and older women, while also highlighting stereotypical emotional associations linked to these demographics. These findings underscore the pervasive nature of biases in a dataset that is foundational for training many AI systems, raising critical concerns about the implications for AI behavior and outputs.
The LAION-5B dataset is riddled with biases, overrepresenting young White males while underrepresenting minorities and older women, which could skew AI outputs in unforeseen ways.
Large-scale image-text datasets, such as LAION-5B, are foundational to modern AI systems, yet their vast scale and uncurated nature raise significant concerns about demographic and stereotypical biases. This study presents a comprehensive analysis of the demographic composition and representational, stereotypical, and intersectional biases in LAION-2B-en and LAION-2B-multi, the two main components of the LAION-5B dataset. Using state-of-the-art models -- FairFace, DeepFace, and Emo-AffectNet -- we analyze faces detected in the dataset to identify biases across age, gender, race, and expressed emotion. Our findings reveal substantial overrepresentation of young adults (20--39), White individuals, and males, alongside consistent underrepresentation of minority racial groups and middle-aged or older women across both dataset components. We also observe stereotypical associations between demographic attributes and emotions, such as ``Anger'' being predominantly linked to males and ``Happiness'' to females, pointing to systemic imbalances in the data. The consistency of these patterns across two demographic models and both components of LAION-5B demonstrates that these biases are deeply embedded in one of the most widely-used training datasets. Given the scale at which LAION-5B is used to train generative models, these demographic imbalances could shape the behavior and outputs of numerous downstream AI systems.
