Search papers, labs, and topics across Lattice.
This paper investigates the alignment between algorithmic metrics for counterfactual explanations and human perception of explanation quality. Through an empirical study involving human ratings of counterfactuals across three datasets, the authors compare these ratings with a comprehensive set of standard counterfactual metrics. The key finding is that correlations between algorithmic metrics and human judgments are weak and dataset-dependent, suggesting that current metrics do not adequately capture human-relevant aspects of explanation quality.
Algorithmic metrics for counterfactual explanations? Turns out humans don't really agree with them.
Explainability is widely regarded as essential for trustworthy artificial intelligence systems. However, the metrics commonly used to evaluate counterfactual explanations are algorithmic evaluation metrics that are rarely validated against human judgments of explanation quality. This raises the question of whether such metrics meaningfully reflect user perceptions. We address this question through an empirical study that directly compares algorithmic evaluation metrics with human judgments across three datasets. Participants rated counterfactual explanations along multiple dimensions of perceived quality, which we relate to a comprehensive set of standard counterfactual metrics. We analyze both individual relationships and the extent to which combinations of metrics can predict human assessments. Our results show that correlations between algorithmic metrics and human ratings are generally weak and strongly dataset-dependent. Moreover, increasing the number of metrics used in predictive models does not lead to reliable improvements, indicating structural limitations in how current metrics capture criteria relevant for humans. Overall, our findings suggest that widely used counterfactual evaluation metrics fail to reflect key aspects of explanation quality as perceived by users, underscoring the need for more human-centered approaches to evaluating explainable artificial intelligence.
