Search papers, labs, and topics across Lattice.
This paper introduces Debias-SparseGPT, a novel post-training pruning method designed to mitigate bias amplification in Large Language Models (LLMs) caused by weight sparsification techniques like SparseGPT. By incorporating representational debiasing through a second-order term across demographically contrasting inputs, the method effectively reduces bias while maintaining model performance metrics such as perplexity and zero-shot accuracy. Empirical results demonstrate that Debias-SparseGPT outperforms SparseGPT across various sparsity levels, particularly under stringent conditions, thereby enhancing both fairness and efficiency in model deployment.
Pruning LLMs can amplify biases, but Debias-SparseGPT shows that you can reduce these biases while maintaining performance, even under aggressive sparsity constraints.
Model compression techniques such as pruning and quantization facilitate the efficient deployment and acceleration of Large Language Models (LLMs). However, recent studies show that weight sparsification methods, such as SparseGPT, can amplify existing biases in models, with outputs varying significantly depending on persona cues in the prompt. In this paper, we introduce Debias-SparseGPT, a post-training pruning method incorporating representational debiasing using a second-order term defined over demographically contrasting inputs. We perform empirical validation of our method over a wide range of generative LLMs. Across models and sparsity regimes (25%, 50%, and structured 2:4 sparsity), Debias-SparseGPT consistently reduces pruning-induced bias compared to SparseGPT while preserving model perplexity and zero-shot accuracy. Under the most restrictive 2:4 structured sparsity pattern, which most aggressively degrades model quality, augmenting the calibration set with long-context, content-rich examples further improves both downstream performance and fairness. Overall, Debias-SparseGPT advances the bias-performance trade-off while preserving the computational efficiency of sparse models.
