Search papers, labs, and topics across Lattice.
The paper identifies critical flaws in Local Shapley Values and LIME, showing they can incorrectly attribute importance to irrelevant features even under ideal conditions. To address this, they introduce R-LOCO, a novel method that segments the input space into regions of similar feature importance and applies global attribution methods within those regions. Experiments demonstrate that R-LOCO provides more faithful local attributions by avoiding local explanation instability while preserving instance-specific detail.
Popular local attribution methods like LIME and Shapley Values can assign importance to completely irrelevant features, even with independent features and exact computations.
We analyze two widely used local attribution methods, Local Shapley Values and LIME, which aim to quantify the contribution of a feature value $x_i$ to a specific prediction $f(x_1, \dots, x_p)$. Despite their widespread use, we identify fundamental limitations in their ability to reliably detect locally important features, even under ideal conditions with exact computations and independent features. We argue that a sound local attribution method should not assign importance to features that neither influence the model output (e.g., features with zero coefficients in a linear model) nor exhibit statistical dependence with functionality-relevant features. We demonstrate that both Local SV and LIME violate this fundamental principle. To address this, we propose R-LOCO (Regional Leave Out COvariates), which bridges the gap between local and global explanations and provides more accurate attributions. R-LOCO segments the input space into regions with similar feature importance characteristics. It then applies global attribution methods within these regions, deriving an instance's feature contributions from its regional membership. This approach delivers more faithful local attributions while avoiding local explanation instability and preserving instance-specific detail often lost in global methods.
