Search papers, labs, and topics across Lattice.
This study investigates the assumption that structural differences in discovered circuits from circuit discovery methods indicate distinct mechanisms by varying input statistics while keeping the task constant. The authors reveal a phenomenon termed "phantom specialization," where structurally distinct circuits yield similar functional outcomes, demonstrating that many circuits can implement the same computation. Their findings underscore the importance of edge-level evaluation and cross-condition transfer tests to accurately assess the relationship between circuit structure and function, challenging conventional evaluation practices that may misrepresent circuit behavior.
Structural differences in circuits may be misleading, as they often reflect interchangeable mechanisms rather than distinct functionalities.
Circuit discovery methods identify subgraphs that explain specific model behaviors, and structural differences between discovered circuits are commonly interpreted as evidence of distinct mechanisms. We test this assumption by varying input statistics while holding the task fixed, and show that the resulting structural differences exhibit apparent specialization but do not correspond to functional differences, a pattern we term phantom specialization. Using Literal Sequence Copying across four token-frequency bands plus a control condition in five Pythia models (70M-1.4B), we extract 75 circuits and find that structurally distinct circuits implement the same computation: band-specific edges transfer broadly across bands, a core shared across most bands recovers at least 99% of circuit performance, and causal interchange interventions confirm that internal representations are interchangeable across frequency bands. Repeated extractions within the same frequency band further suggest that discovery algorithms sample from an equivalence class of valid subgraphs rather than recovering a unique mechanism. Standard evaluation practice obscures this pattern: source-level evaluation inflates apparent faithfulness, while edge-level evaluation reveals the many-to-one mapping from structure to function. Our results show that structural differences between circuits are not sufficient evidence for distinct mechanisms, and that exposing this requires edge-level evaluation and cross-condition transfer tests.
