Search papers, labs, and topics across Lattice.
This paper introduces PEFT-MedSAM, a parameter-efficient fine-tuning approach for the Medical Segment Anything Model (MedSAM) that focuses on the segmentation of dermoscopic skin lesions. By utilizing a frozen pre-trained image encoder and prompt encoder while training only the lightweight mask decoder, the method achieves a dice coefficient of 0.9411 and an intersection over union of 0.8918 on the ISIC 2018 benchmark, outperforming both a fully trained U-Net baseline and zero-shot MedSAM inference. Additionally, external validation on the PH2 dataset yields a dice coefficient of 0.9467, supported by rigorous statistical testing that underscores the model's robustness and clinical applicability through Grad-CAM explainability.
Achieving a dice coefficient of 0.9411 with a lightweight fine-tuning method could revolutionize skin lesion segmentation in clinical settings.
Automated segmentation of skin lesions using deep learning models for dermoscopic images can be very helpful in finding melanomas earlier than they would normally be detected. However, most deep learning methods available do not perform well. The aim of this paper is to present a parameter-efficient fine-tuning method called PEFT-MedSAM for adapting the Medical Segment Anything Model (MedSAM) to automatically segment dermoscopic skin lesions. The PEFT-MedSAM method uses only the lightweight mask decoder for training the model while keeping the pre-trained image encoder and prompt encoder frozen. The experiments performed on the ISIC 2018 benchmark dataset shows that PEFT-MedSAM obtains a dice coefficient of .9411 and an intersection over union value of .8918 when compared to both a fully trained U-Net baseline (.8715 dice coefficient) and zero-shot MedSAM inference (.8997 dice coefficient). The external validation of the model using PH2 dataset shows .9467 dice coefficient with +/- .0310 standard deviation. Supportive evidence for these claims include a p-value less than .0001 for Wilcoxon signed rank tests comparing the two datasets and bootstrap-estimated 95% confidence intervals of [.9364,.9447] that represent the estimated range of possible values for the average dice coefficient obtained by repeating the test. To increase clinical trustworthiness, we used Grad-CAM explainability along with a pointing game based evaluation methodology to evaluate the CNN baseline model on the validation set. The results showed that we had an accuracy rate of 98.27% on the validation set of 519 images and confirmed that the model classified regions containing skin lesions.
