Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces PolypVision, a three-stage hierarchical deep learning framework designed for the classification and segmentation of colorectal polyps, which are critical precursors to colorectal cancer. By employing EfficientNetV2-M and UNet++ architectures, the framework achieves high accuracy in binary classification, segmentation, and adenoma subtype classification across multiple public datasets, with an AUC of approximately 0.99 and a detection mAP@50 of 94.4%. The model's effectiveness is further validated through Gradient-weighted Class Activation Maps (Grad-CAM), ensuring it focuses on clinically relevant features, and it operates independently of specific endoscopic imaging hardware.
PolypVision achieves near-perfect accuracy in polyp classification and segmentation, setting a new benchmark for automated colorectal cancer screening tools.
Colorectal cancer (CRC) remains one of the leading causes of cancer-related mortality worldwide, predominantly arising from precancerous polyps. Accurate detection, segmentation, and endoscopic and histological classification of colorectal polyps are crucial for timely clinical intervention. In this study, we present PolypVision, a three-stage hierarchical deep learning framework that sequentially performs: (Stage 1) binary classification of polyps as adenomatous or hyperplastic, with simultaneous Paris and JNet classification, using EfficientNetV2-M with Focal Loss; (Stage 2) polyp segmentation with recommended resection method using a UNet++ decoder with the Stage 1 backbone as encoder, optimized with Dice and BCE losses; and (Stage 3) adenoma subtype classification (tubular, tubulovillous, villous) using EfficientNetV2-M with transfer learning from Stage 2. Evaluated on three public datasets -- PolypGen, Kvasir-SEG, and CVC-ClinicDB -- PolypVision achieves an AUC of approximately 0.99 for frame classification and a detection mAP@50 of 94.4% on Kvasir-SEG, outperforming or matching state-of-the-art methods. Gradient-weighted Class Activation Maps (Grad-CAM) confirm that the model attends to clinically relevant lesion features. The framework is device-independent, operating across diverse endoscopic imaging systems without hardware-specific adaptation. These results demonstrate that a hierarchical, transfer-learning-driven pipeline with task-specific loss functions offers a robust, device-independent, and clinically meaningful approach to automated colorectal polyp analysis. PolypVision is freely available as a web application at https://polypvision.com, a DataBioX initiative, with a free usage tier open to all users.