Search papers, labs, and topics across Lattice.
The paper introduces Same Class Neighbor Penalization (SCNP), a method to improve topological accuracy in image segmentation by penalizing logits based on the classification of neighboring pixels. This approach encourages the model to refine predictions in a spatially consistent manner, leading to more accurate segmentation of connected components and structures. SCNP is shown to be effective across diverse datasets and segmentation frameworks, improving topology accuracy without significant computational overhead.
Achieve topologically-aware image segmentation without cumbersome architectures or expensive computations: SCNP makes it easy.
Standard deep learning models for image segmentation cannot guarantee topology accuracy, failing to preserve the correct number of connected components or structures. This, in turn, affects the quality of the segmentations and compromises the reliability of the subsequent quantification analyses. Previous works have proposed to enhance topology accuracy with specialized frameworks, architectures, and loss functions. However, these methods are often cumbersome to integrate into existing training pipelines, they are computationally very expensive, or they are restricted to structures with tubular morphology. We present SCNP, an efficient method that improves topology accuracy by penalizing the logits with their poorest-classified neighbor, forcing the model to improve the prediction at the pixels'neighbors before allowing it to improve the pixels themselves. We show the effectiveness of SCNP across 13 datasets, covering different structure morphologies and image modalities, and integrate it into three frameworks for semantic and instance segmentation. Additionally, we show that SCNP can be integrated into several loss functions, making them improve topology accuracy. Our code can be found at https://jmlipman.github.io/SCNP-SameClassNeighborPenalization.
