Search papers, labs, and topics across Lattice.
This paper identifies a critical failure mode in large language models (LLMs) called deductive stereotyping, where models apply general statistical trends to individual cases, resulting in biased inferences despite logical coherence. To address this issue, the authors introduce a reasoning-time injection framework alongside Fair-GCG, a method for discovering effective phrases that promote fairness-aware reasoning. The results demonstrate that these injection phrases significantly enhance performance on various fairness benchmarks, reduce bias in generative tasks, and transfer effectively to real-world applications.
Deductive stereotyping in LLMs leads to biased reasoning, but targeted injection phrases can dramatically enhance fairness across diverse tasks.
Warning: This paper contains several toxic and offensive statements. While reasoning generally improves fairness in recent large language models (LLMs), failures persist. In this work, we identify a failure mode, deductive stereotyping, in which models apply population-level statistical regularities to individual cases, producing logically coherent yet socially biased inferences. We provide a statistical interpretation of this phenomenon. To steer models toward fairness-aware reasoning, we propose a reasoning-time injection framework. We further introduce Fair-GCG to systematically discover effective injection phrases. Injection phrases discovered by Fair-GCG improve performance across multiple fairness benchmarks, generalize from smaller to larger LLMs, improves reasoning-level fairness, reduces bias in open-ended generation, and transfer to real-world fairness-sensitive tasks.
