Search papers, labs, and topics across Lattice.
The paper introduces Generative Causal Mediation (GCM), a method to identify and select specific model components like attention heads that mediate a binary concept difference in long-form language model responses. GCM constructs a dataset of contrasting inputs and responses, then quantifies the mediation effect of individual components to identify those most influential for steering a target concept. Experiments across refusal, sycophancy, and style transfer tasks on multiple language models demonstrate GCM's ability to localize and control long-form responses, outperforming correlational probe-based baselines.
Precisely steer LLM behaviors like refusal, sycophancy, and style transfer by surgically activating just a few key attention heads identified via Generative Causal Mediation.
Where should we intervene in a language model (LM) to control behaviors that are diffused across many tokens of a long-form response? We introduce Generative Causal Mediation (GCM), a procedure for selecting model components, e.g., attention heads, to steer a binary concept (e.g., talk in verse vs. talk in prose) from contrastive long-form responses. In GCM, we first construct a dataset of contrasting inputs and responses. Then, we quantify how individual model components mediate the contrastive concept and select the strongest mediators for steering. We evaluate GCM on three tasks--refusal, sycophancy, and style transfer--across three language models. GCM successfully localizes concepts expressed in long-form responses and consistently outperforms correlational probe-based baselines when steering with a sparse set of attention heads. Together, these results demonstrate that GCM provides an effective approach for localizing and controlling the long-form responses of LMs.
