Search papers, labs, and topics across Lattice.
This study investigates the attention mechanisms of neural networks in the context of speaker recognition, focusing on the visualization and evaluation of attention maps generated by class activation map (CAM)-based methods. By systematically reviewing existing evaluation algorithms and proposing the Modified Randomised Input Sampling for Explanation - Evaluation (Modified RISE-eval), the authors address key shortcomings in attention map evaluation. The findings reveal that GradCAM and LayerCAM each have unique strengths depending on the experimental conditions, providing insights into their effectiveness for speaker recognition tasks.
Attention maps from speaker recognition models reveal that GradCAM and LayerCAM excel under different conditions, challenging the one-size-fits-all approach in XAI.
Explaining and understanding the decision-making process of artificial intelligence (AI) systems, particularly those implemented by neural networks, falls within the field of explainable AI (XAI). Analogous to the human attention mechanism, neural networks are assumed to possess their own attention mechanisms that selectively process information during decision-making. This work proposes to study one XAI topic: analysing and visualising the attention mechanisms of neural networks. Our experiments are performed on speaker recognition neural networks that are trained to identify speaker identity from a given utterance. Previous studies have widely used class activation map (CAM)-based methods to analyse and visualise the attention mechanisms of neural networks. Each of these methods produces an attention map for each network input, highlighting which input regions are selectively processed when the speaker recognition network makes decisions. However, the evaluation of attention maps produced by these methods remains largely underexplored. This work systematically reviews an existing attention map evaluation algorithm, establishing key concepts and identifying its shortcomings. On the basis of this existing evaluation algorithm, a new version is then proposed to address the identified shortcomings, called the Modified Randomised Input Sampling for Explanation - Evaluation algorithm (Modified RISE-eval). Using Modified RISE-eval, we evaluate the attention maps produced by two representative CAM-based methods, GradCAM and LayerCAM, applied to a certain speaker recognition network. The evaluation results demonstrate that GradCAM and LayerCAM each exhibit distinct advantages when applied under different experimental conditions in the speaker recognition task.
