Representative Spectral Correlation Network for Multisource Remote Sensing Image Classification

Hyperspectral image (HSI) and synthetic aperture radar (SAR)/light detection and ranging (LiDAR) data offer complementary spectral and structural information for land-cover classification. However, their effective fusion remains challenging due to two major limitations: the spectral redundancy in high-dimensional HSI and the heterogeneous characteristics between multisource data. To this end, we propose a representative spectral correlation network (RSCNet), a novel multisource image classification framework specifically designed to address the above challenges through spectral selection and adaptive interaction. The network incorporates two key components: 1) key band selection module (KBSM) that adaptively selects task-relevant spectral bands from the original HSI under cross-source guidance, thereby alleviating redundancy and mitigating information loss from conventional principal component analysis (PCA)-based spectral reduction. Moreover, the learned band subset exhibits highly discriminative spectral structures that align with discriminative semantic cues, promoting compact yet expressive representations, and 2) cross-source adaptive fusion module (CAFM) that performs cross-source attention weighting and local–global contextual refinement to enhance cross-source feature interaction. Experiments on three public benchmark datasets demonstrate that our RSCNet achieves superior performance compared with state-of-the-art methods, while maintaining substantially lower computational complexity. Our codes are publicly available at https://github.com/oucailab/RSCNet