Search papers, labs, and topics across Lattice.
This paper introduces a novel algorithm for efficiently generating provably cardinally-minimal explanations for Neural Additive Models (NAMs). The algorithm leverages the additive structure of NAMs to reduce the number of verification queries needed to find the minimal feature subset to logarithmic in the number of input features. Empirical results demonstrate that the proposed approach outperforms existing methods in terms of explanation size and computation time, while also providing benefits over sampling-based interpretation techniques.
Provably minimal explanations for neural networks are now tractable: a new algorithm slashes the query complexity for Neural Additive Models from exponential to logarithmic.
Despite significant progress in post-hoc explanation methods for neural networks, many remain heuristic and lack provable guarantees. A key approach for obtaining explanations with provable guarantees is by identifying a cardinally-minimal subset of input features which by itself is provably sufficient to determine the prediction. However, for standard neural networks, this task is often computationally infeasible, as it demands a worst-case exponential number of verification queries in the number of input features, each of which is NP-hard. In this work, we show that for Neural Additive Models (NAMs), a recent and more interpretable neural network family, we can efficiently generate explanations with such guarantees. We present a new model-specific algorithm for NAMs that generates provably cardinally-minimal explanations using only a logarithmic number of verification queries in the number of input features, after a parallelized preprocessing step with logarithmic runtime in the required precision is applied to each small univariate NAM component. Our algorithm not only makes the task of obtaining cardinally-minimal explanations feasible, but even outperforms existing algorithms designed to find the relaxed variant of subset-minimal explanations - which may be larger and less informative but easier to compute - despite our algorithm solving a much more difficult task. Our experiments demonstrate that, compared to previous algorithms, our approach provides provably smaller explanations than existing works and substantially reduces the computation time. Moreover, we show that our generated provable explanations offer benefits that are unattainable by standard sampling-based techniques typically used to interpret NAMs.
