Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces influence-weighted activation transport, a novel method for inference-time steering of language models by leveraging influence functions to identify and weight data points that most thematically express a target concept. By incorporating loss landscape curvature, influence functions capture concept-relevant relationships beyond superficial token similarity, addressing limitations of existing contrastive averaging approaches. Experiments on toxicity suppression, object induction, and truthfulness induction demonstrate improved steering performance while preserving model quality.
Influence functions, not just activation averages, unlock more thematic and robust concept steering in LLMs.
Inference-time steering offers cheap, fine-grained control over a language model's outputs by estimating a concept's representation in activation space and shifting activations towards it. Existing methods build these representations from activation averages over contrastive datasets. These averages incorporate unrelated concepts and noise, and are dominated by a few tokens, meaning the activation transport encodes token-level rather than thematic concepts. In this work, we steer towards examples that most express a concept thematically, rather than towards an expectation over all. We identify these examples using influence functions, which estimate how much each data point contributes to a model's representation of a concept. Unlike simple model activation similarity, they incorporate the curvature of the model's loss landscape, allowing them to capture concept-relevant relationships beyond superficial token-level similarity. We then propose influence-weighted activation transport, which uses optimal transport to steer activations of non-concept text towards those of concept text, weighting concept examples by their influence scores. We evaluate on toxicity suppression (Jigsaw), object-based concept induction (OneSec) and truthfulness induction (TruthfulQA), outperforming existing activation-transport baselines. We track capability after steering using perplexity and MMLU accuracy, finding that our method improves steering while largely preserving model quality. We further show that influence functions capture concept-relevant information that activation-based methods miss with the two approaches ranking data points significantly differently. Together, these results demonstrate the value of curvature-aware influence information for activation steering.