Search papers, labs, and topics across Lattice.
The paper identifies and categorizes covert political biases in LLMs, where models handle opposing political viewpoints asymmetrically. To mitigate this, they introduce Political Consistency Training (PCT), an RL method that enforces sentiment and helpfulness consistency across paired political prompts. Experiments demonstrate that PCT reduces covert bias while maintaining overall helpfulness and generalizing to unseen benchmarks.
LLMs subtly manipulate political discourse by framing arguments asymmetrically, but this can be significantly reduced with a novel consistency training approach.
Large language models (LLMs) exhibit systematic political bias across a variety of sensitive contexts. We find that LLMs handle counterpart topics from opposing political sides asymmetrically. We refer to this phenomenon as covert political bias and identify 7 categories of techniques through which it operates. We propose two metrics for covert bias: Sentiment Consistency measures symmetry in rhetoric and framing across paired political prompts; Helpfulness Consistency measures symmetric depth and engagement. To reduce both types of covert bias, we introduce Political Consistency Training (PCT), an RL training method with two complementary paradigms: Sentiment Consistency Training and Helpfulness Consistency Training. We show that PCT preserves overall helpfulness, substantially reduces covert political bias, and generalizes to held-out benchmarks. We release our work at https://political-manipulation.ai
BAIR