Search papers, labs, and topics across Lattice.
The paper introduces PanopMamba, a hybrid encoder-decoder architecture incorporating Mamba and Transformer blocks with state space modeling for nuclei panoptic segmentation in histopathology images. PanopMamba uses a multiscale Mamba backbone and an SSM-based fusion network to improve long-range perception and feature representation, addressing challenges like small object detection and ambiguous boundaries. Experiments on MoNuSAC2020 and NuInsSeg datasets demonstrate that PanopMamba outperforms state-of-the-art methods, and the paper introduces new evaluation metrics ($i$PQ, $w$PQ, and $fw$PQ) to better assess performance in this domain.
Mamba's long-range perception and efficient processing power up a new state-of-the-art for nuclei panoptic segmentation, outperforming previous methods on complex histopathology images.
Nuclei panoptic segmentation supports cancer diagnostics by integrating both semantic and instance segmentation of different cell types to analyze overall tissue structure and individual nuclei in histopathology images. Major challenges include detecting small objects, handling ambiguous boundaries, and addressing class imbalance. To address these issues, we propose PanopMamba, a novel hybrid encoder-decoder architecture that integrates Mamba and Transformer with additional feature-enhanced fusion via state space modeling. We design a multiscale Mamba backbone and a State Space Model (SSM)-based fusion network to enable efficient long-range perception in pyramid features, thereby extending the pure encoder-decoder framework while facilitating information sharing across multiscale features of nuclei. The proposed SSM-based feature-enhanced fusion integrates pyramid feature networks and dynamic feature enhancement across different spatial scales, enhancing the feature representation of densely overlapping nuclei in both semantic and spatial dimensions. To the best of our knowledge, this is the first Mamba-based approach for panoptic segmentation. Additionally, we introduce alternative evaluation metrics, including image-level Panoptic Quality ($i$PQ), boundary-weighted PQ ($w$PQ), and frequency-weighted PQ ($fw$PQ), which are specifically designed to address the unique challenges of nuclei segmentation and thereby mitigate the potential bias inherent in vanilla PQ. Experimental evaluations on two multiclass nuclei segmentation benchmark datasets, MoNuSAC2020 and NuInsSeg, demonstrate the superiority of PanopMamba for nuclei panoptic segmentation over state-of-the-art methods. Consequently, the robustness of PanopMamba is validated across various metrics, while the distinctiveness of PQ variants is also demonstrated. Code is available at https://github.com/mkang315/PanopMamba.
