Search papers, labs, and topics across Lattice.
This study investigates how inferred developer attributes, such as age and gender, impact the outputs of generative AI in software engineering, specifically focusing on interface design, template content, and code structure. Through controlled experiments with 800 AI-generated websites, the authors demonstrate that these personal signals significantly alter the generated artifacts. Additionally, observational studies and interviews reveal that developers are often unaware of the bias introduced by personalization, underscoring a critical tension between enhancing user experience and maintaining fairness in AI-generated software.
Personalization in AI-driven development can introduce significant biases, with age and gender influencing the very structure of generated code.
Generative AI is increasingly permeating software engineering, enabling developers to generate functions, files, and even entire applications from natural language specifications. AI systems are also becoming more personalized, adapting outputs based on inferred user characteristics and interaction history. While personalization may improve the development experience, it raises concerns that generated software could be shaped by attributes of the developer rather than by task requirements alone. Prior work has shown that generative AI can produce biased software artifacts, but little is known about how developer identity can bias generated code. We characterize three dimensions through which inferred developer attributes can influence generated artifacts: interface design, template content, and code structure. First, through controlled experiments on 800 AI-generated websites, we find that age- and gender-related signals produce significant differences across all three dimensions. Second, we conduct an observational study and follow-up interviews with 20 participants who used AI to create a personal website to both examine how personalization impacts software artifacts in practice, and also to understand how programmers perceive the boundary between personalization and bias. Together, our results show that developer attributes can meaningfully influence generated software beyond stated requirements, highlighting a previously underexplored tension between personalization and fairness in AI-assisted programming.
