Search papers, labs, and topics across Lattice.
The paper introduces Certified Circuits, a framework for improving the stability and reliability of mechanistic circuit discovery in neural networks. They address the brittleness of existing circuit discovery methods by using randomized data subsampling to certify the invariance of circuit component inclusion to bounded perturbations of the concept dataset. This approach abstains from unstable neurons, resulting in more compact and accurate circuits that generalize better to out-of-distribution data, as demonstrated on ImageNet.
Mechanistic interpretability gets a formal footing: "Certified Circuits" uses data subsampling to find provably stable sub-networks, boosting accuracy by up to 91% while using 45% fewer neurons.
Understanding how neural networks arrive at their predictions is essential for debugging, auditing, and deployment. Mechanistic interpretability pursues this goal by identifying circuits - minimal subnetworks responsible for specific behaviors. However, existing circuit discovery methods are brittle: circuits depend strongly on the chosen concept dataset and often fail to transfer out-of-distribution, raising doubts whether they capture concept or dataset-specific artifacts. We introduce Certified Circuits, which provide provable stability guarantees for circuit discovery. Our framework wraps any black-box discovery algorithm with randomized data subsampling to certify that circuit component inclusion decisions are invariant to bounded edit-distance perturbations of the concept dataset. Unstable neurons are abstained from, yielding circuits that are more compact and more accurate. On ImageNet and OOD datasets, certified circuits achieve up to 91% higher accuracy while using 45% fewer neurons, and remain reliable where baselines degrade. Certified Circuits puts circuit discovery on formal ground by producing mechanistic explanations that are provably stable and better aligned with the target concept. Code will be released soon!
