Search papers, labs, and topics across Lattice.
This paper compares the performance of ML-based and LLM-based bias mitigation techniques in software fairness tasks. Through a large-scale empirical study, the authors demonstrate that traditional ML methods consistently outperform LLMs in both fairness and predictive accuracy, even when using strong LLMs. They identify that previous studies showing LLM advantages were often based on artificially balanced test data and that LLMs often fail to fully leverage training data via in-context learning.
LLMs underperform traditional ML methods in software fairness tasks, challenging the assumption that they offer a silver bullet solution for bias mitigation.
Fairness is a critical requirement for human-related, high-stakes software systems, motivating extensive research on bias mitigation. Prior work has largely focused on tabular data settings using traditional Machine Learning (ML) methods. With the rapid rise of Large Language Models (LLMs), recent studies have begun to explore their use for bias mitigation in the same setting. However, it remains unclear whether LLM-based methods offer advantages over traditional ML methods, leaving software engineers without clear guidance for practical adoption. To address this gap, we present a large-scale study comparing state-of-the-art ML- and LLM-based bias mitigation methods. We find that ML-based methods consistently outperform LLM-based methods in both fairness and predictive performance, with even strong LLMs failing to surpass established ML baselines. To understand why prior LLM-based studies report favorable results, we analyze their evaluation settings and show that these gains are largely driven by artificially balanced test data rather than realistic imbalanced distributions. We further observe that existing LLM-based methods primarily rely on in-context learning and thus fail to leverage all available training data. Motivated by this, we explore supervised fine-tuning on the full training set and find that, while it achieves competitive results, its advantages over traditional ML methods remain limited. These findings suggest that LLMs are not a silver bullet for software fairness.
Tsinghua AI