Search papers, labs, and topics across Lattice.
The TEAMS framework introduces a novel vision-language Mamba snake approach that addresses the limitations of existing deep snake methods in instance segmentation by incorporating a Spatiotemporal Snake Evolution Strategy, a Contour Morphology-Aware Mamba, and a Text-prompted Collaborative Dual-Head Snake. These innovations enable the model to effectively handle complex morphological variations and improve the accuracy of fine-grained organ detail delineation while reducing detection errors. Evaluations across multiple datasets reveal that TEAMS significantly outperforms traditional segmentation methods, achieving notable improvements in metrics such as mDice and mBF.
TEAMS achieves a remarkable 6.9% improvement in mDice on spinal datasets, showcasing its superior capability in medical image segmentation.
Deep snake is a promising family of instance segmentation methods that accurately predicts object-level contours, thereby overcoming common pixel-level misclassification issues such as mask cavities and jagged edges in semantic segmentation approaches. However, existing deep snake methods face challenges in handling complex morphological variations, accurately capturing fine-grained organ details, and correcting base detection errors. To mitigate these limitations, we propose a cohesive Text-prompted spatiotEmporal dual-heAd Mamba Snake (TEAMS), a novel vision-language Mamba snake framework with three key innovations: (1) A Spatiotemporal Snake Evolution Strategy (SSES) is introduced to tackle complex morphological variations by capturing bidirectional spatial dependencies along the snake contour and temporal dynamics across evolution steps in a state space model. (2) A Contour Morphology-Aware Mamba (CMAM) is proposed to quantify local contour morphologies to modulate the structured attention mask in the Mamba2 SSD dual form, which extends Mamba's capability to perceive the relative importance of its input sequence elements for better delineation of fine-grained organ details. (3) A Text-prompted Collaborative Dual-Head Snake (TCDHS) is designed to incorporate cues from textual prompts and transfer the evolved contour information to the base detection head, which enhances the deep snake workflow and mitigates wrong detections. Comprehensive evaluations on five datasets covering different organs and imaging modalities demonstrate that TEAMS outperforms existing semantic and deep snake segmentation methods (e.g., relative mDice/mBF improvements of 6.9%/9.1% in a spinal dataset), underscoring its potential as a reliable tool across diverse medical image segmentation scenarios.
