Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To bridge the gap between input-side activations and output-side causal interventions in mechanistic interpretability, this work frames sparse autoencoder (SAE) features as end-to-end functional mappings and evaluates them using an iterative agent called DAFI. The agent replaces expensive full-corpus scans with targeted, short-context token probing while self-refining its interpretations using distilled, transferable skills. On GemmaScope, DAFI outperforms SAGE by 13.1 percentage points on input fidelity and Token Change by 38.9 points on output fidelity, revealing that 70.7% of reliably interpreted features display mismatched input and output semantics.
Over 70% of sparse autoencoder features exhibit fundamentally mismatched input and output semantics, breaking the common assumption that what activates a feature directly mirrors its downstream causal effect.
Sparse autoencoders (SAEs) are an important tool for mechanistic interpretability, but interpreting their many features remains challenging. Existing methods characterize input-side activation patterns and output-side intervention effects, yet often leave their functional connection implicit, while input-side evidence collection typically relies on costly large-corpus scans. We introduce functional interpretation, which characterizes an SAE feature as a mapping from its activating input semantics to its output effects under intervention, and present Dual-End Agentic Feature Interpretation (DAFI), an agent that actively gathers evidence and refines input-side, output-side, and functional interpretations through component-specific feedback. Its short-context token probing enables on-demand activation evidence collection without a full corpus scan. On GemmaScope, DAFI improves Input score by 13.1 percentage points over SAGE and Output score by 38.9 points over Token Change, while being substantially more token-efficient than a general-purpose coding agent. Skills distilled from successful refinements raise the held-out joint pass rate from 58.0% to 92.0% and improve both interpretation quality and efficiency when transferred to a new model-SAE setting. Across features with reliable endpoint interpretations, 70.7% exhibit non-equivalent input and output semantics. On AxBench, DAFI also improves steering-feature selection over output-score filtering. Code is available at https://github.com/THUAIS-Lab/DAFI.
Tsinghua AI