Search papers, labs, and topics across Lattice.
This study systematically investigates the impact of CutMix, a data augmentation technique, on the reliability and robustness of semantic segmentation models, particularly in safety-critical applications like autonomous driving. By evaluating the CNN-based DeepLabV3+ and the transformer-based SegFormer architectures, the authors find that while CutMix has a negligible effect on segmentation accuracy, it significantly enhances model reliability, especially under distribution shifts. This finding highlights the importance of reliable confidence estimates in safety-critical deployments, where trustworthiness can be as crucial as performance metrics.
CutMix boosts the reliability of semantic segmentation models under distribution shifts, even if it doesn't significantly improve accuracy.
Ensuring not only high accuracy but also reliable and robust predictions is critical for the deployment of semantic segmentation models in safety-critical applications such as autonomous driving. Despite the widespread use of CutMix - a simple yet powerful data augmentation strategy - its effect on the reliability and robustness in dense predictions tasks remains unexplored. Motivated by recent findings that semi-supervised segmentation methods, where CutMix is a core component, can severely degrade reliability, this study isolates and systematically analyzes the influence of CutMix on segmentation accuracy, calibration, and uncertainty quality. We evaluate two representative architectures, the CNN-based DeepLabV3+ and the transformer-based SegFormer, across both in-domain and out-of-domain scenarios. Our results show that CutMix has only a minor impact on segmentation accuracy but consistently improves the reliability, particularly under distribution shifts. These improvements indicate that CutMix primarily enhances the trustworthiness of the model's calibration and uncertainty rather than the raw segmentation prediction itself. This distinction is crucial for safety-critical deployment, where reliable confidence estimates are as important as raw performance.
