Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper conducts a causal audit of neuron selectors in language models to assess their effectiveness in identifying crucial neuron rows for tasks like pruning and safety editing. Through one-shot neuron-row zeroing, the authors demonstrate that attribution methods significantly outperform traditional activation and magnitude-based approaches in pinpointing dispensable rows across five large language models. Notably, the study reveals that while rank-stable selectors may appear reliable, they often fail to capture causally important neurons, highlighting the complexity of implementing refusal mechanisms in models while maintaining fluency and minimizing harmful outputs.
Rank-stable neuron selectors can mislead researchers about causally important neurons, risking ineffective safety edits in language models.
Attribution scores increasingly identify which neuron rows of a language model matter for applications such as pruning, interpretability, and editing for safety, yet whether they identify causally important rows is rarely tested directly. We address this with two paired audits built on one-shot neuron-row zeroing. We first audit selectors at the language-modeling level: attribution methods substantially outperform activation and magnitude-based baselines at identifying dispensable rows across five LLMs. We then adapt the same intervention into a behavior test by driving it with a contrastive harmful-versus-benign signal; the attributed rows are sufficient to install refusal on hate and crime while keeping benign over-refusal low and preserving language model fluency, and specific in that layer-matched random controls at the same depths fail. Highly rank-stable selectors can be among the least causally valid. Refusal moreover lives in a redundant subspace, where different attribution methods install it through largely disjoint row sets, so the recovered edit is one realization of a sufficient set rather than a unique mechanism. Together, these findings show that rank-stability proxies miss the kinds of selector failures a direct causal audit can surface.%