Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To bridge the divide between representation learning and mechanistic weight computation, this work develops Activation-Supported Parameter Decomposition (ASPD), which decomposes weight matrices into discrete components explicitly grounded in the activation features they read and write. By utilizing internal activations and a local reconstruction objective at individual weight matrices, ASPD eliminates the classic non-uniqueness bottleneck of isolated parameter factorizations without requiring global end-to-end training. Evaluated on Qwen-3-8B, the method enables scalable, causally editable parameter decompositions that faithfully recover the mechanistic circuits underlying tasks like Indirect Object Identification (IOI).
Parameter matrices are no longer inscrutable black boxes: decomposing weights directly into the activation features they read and write enables scalable, causally editable circuit discovery at 8B scale.
Activation space and parameter space provide complementary views of model computation. Activations represent information, while weights read, transform, and write that information. Yet existing interpretability methods largely study the two spaces separately, leaving the connection between represented information and parameter-level computation underexplored. We introduce Activation-Supported Parameter Decomposition (ASPD), which jointly decomposes activation and parameter spaces and grounds each learned weight component in the activation features it reads or writes. This grounding constrains otherwise non-unique parameter decompositions using the model's internal activations, while an internal reconstruction objective provides a local learning signal at the weight matrix being analyzed. Together, these properties enable scalable, interpretable, and causally editable parameter decomposition in pretrained large language models, demonstrated on Qwen-3-8B. The learned read--write components can also be composed into parameter-level mechanism circuits. We use ASPD to recover mechanisms underlying the classic IOI circuit and trace semantic transformations through model weights.