Search papers, labs, and topics across Lattice.
This paper introduces IViT, an interpretable Visual Transformer designed for skin disease detection that addresses the limitations of existing models in terms of interpretability and adaptability to few-shot learning scenarios. By employing a Quadratic Programming framework for feature selection and a multi-objective loss function, IViT achieves a competitive accuracy of 93.80% while significantly reducing feature redundancy by 29.5%. The model's core activation regions align with clinically relevant lesion areas, enhancing its reliability for clinical applications.
IViT achieves 93.80% accuracy in skin disease detection while reducing feature redundancy by 29.5%, striking a crucial balance between interpretability and performance.
The clinical diagnosis of skin diseases is susceptible to interference from inter-class similarity of skin lesions, and over-reliance on clinicians'experience easily leads to subjective bias. Although existing deep learning aided diagnosis methods achieve competitive accuracy, they suffer from the black-box opacity of Vision Transformer (ViT) and poor adaptability to medical few-shot scenarios. Moreover, mainstream explainable algorithms generally face the bottleneck of significant accuracy degradation when improving interpretability. This paper proposes an interpretable ViT (IViT) constrained by Quadratic Programming (QP). The introduced pre-trained transfer learning adapts to few-shot feature extraction. A discrete QP feature selection framework is constructed to screen generic and discriminative features consistent with clinical diagnostic logic. A multi-objective loss function is designed to reduce feature redundancy and optimize activation distribution while preserving classification performance. Experimental results on six standard skin disease datasets show that IViT achieves an accuracy of 93.80%, only 0.21% lower than the baseline, with feature redundancy reduced by 29.5%. Its core activation regions are consistent with clinically concerned lesion areas. The proposed model balances accuracy and interpretability, providing a reliable solution for the clinical deployment of few-shot intelligent skin disease diagnosis.
