Search papers, labs, and topics across Lattice.
This paper introduces CoXAM, a Cognitive XAI-Adaptive Model, to analyze and compare the interpretability of different XAI schemas (weights, rules, and their hybrid) by modeling human reasoning strategies in forward and counterfactual decision tasks. CoXAM uses a shared memory representation and computational rationality to select reasoning processes based on utility and reasoning time. The model demonstrates stronger alignment with human decision-making than baseline ML proxies, replicating empirical findings about the difficulty of counterfactual tasks and the varying effectiveness of XAI techniques based on data context.
Forget benchmarks, CoXAM offers a cognitive model that finally explains *why* some XAI techniques resonate with users better than others.
Rules and Weights are popular XAI techniques for explaining AI decisions. Yet, it remains unclear how to choose between them, lacking a cognitive framework to compare their interpretability. In an elicitation user study on forward and counterfactual decision tasks, we identified 7 reasoning strategies of interpreting three XAI Schemas - weights, rules, and their hybrid. To analyze their capabilities, we propose CoXAM, a Cognitive XAI-Adaptive Model with shared memory representation to encode instance attributes, linear weights, and decision rules. CoXAM employs computational rationality to choose among reasoning processes based on the trade-off in utility and reasoning time, separately for forward or counterfactual decision tasks. In a validation study, CoXAM demonstrated a stronger alignment with human decision-making compared to baseline machine learning proxy models. The model successfully replicated and explained several key empirical findings, including that counterfactual tasks are inherently harder than forward tasks, decision tree rules are harder to recall and apply than linear weights, and the helpfulness of XAI depends on the application data context, alongside identifying which underlying reasoning strategies were most effective. With CoXAM, we contribute a cognitive basis to accelerate debugging and benchmarking disparate XAI techniques.
NUS