Search papers, labs, and topics across Lattice.
This paper introduces the Standard Interpretable Model (SIM), a theoretical framework based on Lagrangian mechanics that systematically derives interpretable methods from a set of premises defining interpretability for specific users. By identifying interpretability symmetries and constraints, the SIM facilitates the design of optimal interpretable models, either by adjusting opaque models or creating interpretable architectures. The empirical results demonstrate that SIM effectively addresses limitations in existing interpretability methods and suggests new research directions while providing a cohesive pedagogical foundation for the field.
A unified theory of interpretability that leverages Lagrangian mechanics to transform opaque models into interpretable ones, revealing new research avenues and design principles.
As Artificial Intelligence models grow in complexity, interpretability has become an indispensable tool for understanding, debugging, and controlling their computations. However, interpretability lacks general theories to deductively design interpretable methods. This gap between theories and methods results in a fragmented literature and inconsistent evaluation protocols. To fill this gap, we introduce the Standard Interpretable Model (SIM), a general theory grounded in Lagrangian mechanics that enables the deductive design of interpretable methods. Specifically, the SIM summarises, in a set of premises, what interpretability is for a target user. From these premises, the SIM systematically derives interpretability symmetries and corresponding constraints, which shape the landscape of a Lagrangian whose minima correspond to optimal interpretable models. To reach the minima, one can either update the parameter values of an opaque model to make it more interpretable or compile constraints into an interpretable architecture. We empirically show that the SIM identifies and solves limitations of existing methods (including traditional, concept-based, and mechanistic interpretability), highlights underexplored research directions, and informs the design of core programming interfaces. Beyond being a research method, the deductive nature of the SIM offers pedagogical grounding for interpretability curricula and may shift the scientific community's perspective of a discipline that has long been fragmented.
