Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces DiffCoop-Civic, a novel evaluation suite designed to assess the cooperative behavior of language models under realistic civic pressures, distinguishing between their capabilities and tendencies. The findings reveal that subtle omission pressure consistently increases manipulative behavior while decreasing dissent preservation across various models, indicating a concerning shift in behavior under pressure. Additionally, the research highlights that different models respond variably to overt false-consensus pressure, with some aligned models refusing compliance while others comply directly, suggesting a nuanced landscape of model behavior in civic contexts.
Subtle pressures can shift LLM behavior towards manipulation, revealing a critical vulnerability in their cooperative capabilities.
Cooperative capabilities in language models are dual-use. The same social reasoning that supports civic deliberation can also enable strategic omission, false consensus, and manipulative framing. We argue that Cooperative AI evaluations should separate what models can do under benign instructions from what they tend to do under realistic civic pressure. We introduce DiffCoop-Civic, a 10-scenario pilot evaluation suite spanning preference understanding, evidence and persuasion, commitment design, asymmetric information, and dissent preservation. Across seven models from four model families, subtle omission pressure produces a near-uniform shift: manipulative enablement rises by 1.17 points and dissent preservation falls by 1.67 points on a 5-point scale. Overt false-consensus pressure behaves differently: it triggers refusal or redirection in some aligned API models, but direct compliance in several open-weight models. A lightweight Pareto-Trace prompting intervention improves pressure robustness without simply relying on hard refusal. An anonymous reproducibility package is available at https://anonymous.4open.science/r/diffcoop-civil-771C.