Search papers, labs, and topics across Lattice.
This paper investigates the impact of ground truth (GT) errors on deep learning models for echocardiography segmentation, focusing on random and systematic errors. They compare loss-based and Variance of Gradients (VOG)-based methods for detecting GT errors during training, and introduce a pseudo-labeling approach to correct these errors. Experiments on the CAMUS dataset reveal that VOG effectively identifies erroneous labels, and that the proposed detection and refurbishment strategy improves segmentation performance, especially when error rates are high.
Even a standard U-Net can maintain surprisingly strong performance in echocardiography segmentation despite significant ground truth errors, but a Variance of Gradients approach can boost performance further by detecting and correcting those errors during training.
Deep learning-based medical image segmentation typically relies on ground truth (GT) labels obtained through manual annotation, but these can be prone to random errors or systematic biases. This study examines the robustness of deep learning models to such errors in echocardiography (echo) segmentation and evaluates a novel strategy for detecting and refurbishing erroneous labels during model training. Using the CAMUS dataset, we simulate three error types, then compare a loss-based GT label error detection method with one based on Variance of Gradients (VOG). We also propose a pseudo-labelling approach to refurbish suspected erroneous GT labels. We assess the performance of our proposed approach under varying error levels. Results show that VOG proved highly effective in flagging erroneous GT labels during training. However, a standard U-Net maintained strong performance under random label errors and moderate levels of systematic errors (up to 50%). The detection and refurbishment approach improved performance, particularly under high-error conditions.
