Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
This paper introduces DictXAI, a model-independent Explainable AI (XAI) framework that defines concepts directly in the input domain using a dictionary of interpretable elements. By computing a sparse code of the input and attributing predictions to these dictionary elements, DictXAI overcomes the limitations of architecture-specific or feature-dependent XAI methods. The approach demonstrates actionable insights, enabling identification of data artifacts causing AI malfunctions and fostering human-AI alignment on complex signals across diverse data modalities.
AI malfunctions, like Clever Hans effects, can be directly traced to specific artifact patterns in the input data using a model-agnostic dictionary of interpretable concepts.
Modern applications of AI rely on increasingly complex models. Explainable AI (XAI) has emerged as a set of techniques aimed at improving model transparency. However, existing XAI methods typically assume input features to be inherently interpretable, or they rely on intermediate internal abstractions that are difficult to characterize and highly architecture-specific, hindering consistent use across models. To address these limitations, we propose DictXAI, a method that defines concepts directly in the input domain via a dictionary---a large, potentially overcomplete set of predefined elements, each carrying an interpretable meaning. Technically, DictXAI first computes a sparse code of the input and then attributes the model's prediction to the associated dictionary elements. We demonstrate the actionable nature of DictXAI explanations, showing that they can attribute AI malfunctions (e.g., Clever Hans effects) directly to identifiable artifact patterns in the data, while fostering human-AI alignment on intricate biomedical signals. We further demonstrate our method's ability to operate across a wide variety of dictionaries, including learned image bases, analytically defined waveforms for electrocardiography, and experimentally acquired dictionary elements. Overall, our results show that DictXAI provides more interpretable, actionable, and architecture-agnostic insights than classical XAI or existing concept-based approaches.