Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces an interval-valued Shapley value approach for tree-based models to address the known unrobustness of standard Shapley values to small input perturbations. By employing an imprecise Dirichlet model and introducing unannotated instances to tree leaves, the method quantifies Shapley value intervals under common data imputation principles (pessimistic and averaging). Theoretical derivations enable efficient computation of these interval-valued Shapley values, which are then demonstrated to be useful for debiasing uninformative features.
Standard Shapley values are brittle; interval-valued Shapley values reveal their true robustness landscape in tree models.
Shapley values are among the most popular feature-attribution explanations. Efficient approaches for computing/estimating Shapley values for tree-based models, which are state-of-the-art for tabular data sets, have been developed. However, it is known that Shapley values can be (highly) unrobust due to small and realistic changes. In this paper, we propose an imprecise Dirichlet model (IDM) based method to analyze the robustness of Shapley values in decision trees and random forests. Technically, it is done by quantifying and analyzing the interval-valued Shapley values when a few unannotated instances are randomly introduced to the leaves of the trees. The interval-valued Shapley values can be defined following common principles in handling incomplete data: the pessimistic and averaging principles. We derive various theoretical results that lead to efficient computation of the interval-valued Shapley values. We also show that the proposed method can be straightforwardly generalized to the case of Banzhaf values. We then present various case studies and experiments to illustrate the behaviour of the proposed interval-valued Shapley values and their applications in debiasing uninformative features.