Search papers, labs, and topics across Lattice.
This paper introduces a causal inference-based explanation model for medical image segmentation, addressing the lack of explainability in deep learning models used in high-stakes medical scenarios. The method backpropagates the average treatment effect (ATE) to quantify the influence of input regions and network components on target segmentation areas. Experiments on medical imaging datasets demonstrate that the proposed approach provides more faithful explanations compared to existing segmentation explainability techniques and reveals heterogeneity in perceptual strategies across different segmentation models.
Uncover the "why" behind medical image segmentation with a new causal reasoning method that exposes surprising differences in how models perceive images, paving the way for more trustworthy AI in healthcare.
Medical image segmentation plays a vital role in clinical decision-making, enabling precise localization of lesions and guiding interventions. Despite significant advances in segmentation accuracy, the black-box nature of most deep models has raised growing concerns about their trustworthiness in high-stakes medical scenarios. Current explanation techniques have primarily focused on classification tasks, leaving the segmentation domain relatively underexplored. We introduced an explanation model for segmentation task which employs the causal inference framework and backpropagates the average treatment effect (ATE) into a quantification metric to determine the influence of input regions, as well as network components, on target segmentation areas. Through comparison with recent segmentation explainability techniques on two representative medical imaging datasets, we demonstrated that our approach provides more faithful explanations than existing approaches. Furthermore, we carried out a systematic causal analysis of multiple foundational segmentation models using our method, which reveals significant heterogeneity in perceptual strategies across different models, and even between different inputs for the same model. Suggesting the potential of our method to provide notable insights for optimizing segmentation models. Our code can be found at https://github.com/lcmmai/PdCR.
