Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To assess the reliability of visual explanations in video segmentation, the authors benchmark intermediate and final Grad-CAM saliency maps across 2D and ConvLSTM U-Nets using EchoNet-Dynamic. The analysis reveals that while segmentation accuracy remains consistent across architectures and temporal strides, intermediate recurrent layers suffer from severe explanation instability and high saliency centroid motion. Crucially, this work shows that standard frame-wise explanation metrics are structurally incapable of disentangling true temporal feature evolution from explanation noise.
Video models with identical segmentation accuracy can harbor severe internal explanation instability, as intermediate recurrent layers exhibit chaotic saliency jitter that conventional frame-wise XAI tools completely fail to diagnose.
Deep learning has achieved state-of-the-art performance in echocardiographic video segmentation, with an increasing number of models incorporating temporal information. However, quantitative evaluation of temporal explainability remains largely unexplored. We propose a quantitative framework for evaluating Grad-CAM explanations using four complementary metrics measuring temporal consistency, saliency motion, anatomical overlap, and temporal overlap. Using EchoNet-Dynamic, we compare a baseline 2D U-Net with ConvLSTM U-Net models trained across multiple temporal strides. While segmentation performance remained comparable across all models, intermediate ConvLSTM explanations exhibited substantially lower saliency consistency and greater centroid motion than final prediction explanations. Temporal Bottleneck explanations were significantly more stable than Encoder Bottleneck explanations across all strides, while final ConvLSTM Decoder3 explanations were broadly comparable to those of the 2D U-Net. Importantly, conventional frame-wise explanation metrics cannot determine whether variation in intermediate explanations reflects meaningful temporal feature evolution or explanation instability. These findings establish a preliminary quantitative framework for temporal explainability and motivate temporal-aware XAI methods that explicitly account for evolving representations in medical video models.