Search papers, labs, and topics across Lattice.
This paper introduces a region-based graph learning framework for skin lesion classification that models lesions as graphs of spatially coherent superpixel regions, addressing the challenges posed by heterogeneous structures and intra-class variability. By encoding inter-regional geometry as edge attributes and integrating patient metadata through a dedicated context node, the method enhances multimodal reasoning in classification tasks. Experiments across four public benchmarks show that this approach consistently outperforms state-of-the-art methods, highlighting the effectiveness of relational modeling in improving classification robustness and expressiveness.
Explicitly modeling skin lesions as graphs with integrated metadata leads to significant improvements in classification accuracy over traditional CNN/ViT methods.
Automated skin cancer classification from dermoscopic images remains challenging due to heterogeneous lesion structure, strong intra-class variability, and subtle visual differences between benign and malignant cases. Existing CNN/ViT pipelines typically rely on global or patch-level features and often combine patient metadata via late fusion, which limits spatially grounded multimodal reasoning. We present a novel region-based graph learning framework that explicitly models lesions as graphs of spatially coherent superpixel regions represented as frozen CNN features. To capture fine-grained lesion arrangements, we encode inter-regional geometry as edge attributes and introduce a dedicated metadata context node connected to all regions, providing structured integration of demographic/clinical variables within the same relational space. Node representations are updated using our edge-aware graph transformer followed by attention-driven propagation, and a final graph-level embedding for benign-malignant classification. Experiments on four public benchmarks demonstrate that explicit region-level relational modeling and graph-native multimodal fusion yield consistent gains over the state-of-the-art. Consequently, we establish a new graph-centric perspective in which CNN features are modeled as relational nodes and improved through contextual integration, yielding more expressive and robust classifications.
