Search papers, labs, and topics across Lattice.
This paper introduces MBTI, a Multi-Branch efficient fine-tuning framework designed to enhance hyperspectral image classification by preserving full-band spectral information during model adaptation. By employing a spectral-continuity-preserving preprocessing strategy and integrating independent Low-Rank Adaptation (LoRA) modules, MBTI effectively enables the model to learn task-specific features without discarding valuable spectral data. Experimental results demonstrate that MBTI outperforms existing classification methods while maintaining a minimal number of trainable parameters, showcasing its efficiency and effectiveness in hyperspectral image tasks.
Preserving full-band spectral information in hyperspectral image classification can significantly boost model performance while keeping parameter tuning minimal.
Hyperspectral foundation models learn transferable spectral-spatial representations from large-scale unlabeled data. They provide an effective paradigm for adapting to downstream hyperspectral image (HSI) classification tasks with limited labeled samples. However, spectral band configurations vary substantially across sensors, which makes direct model transfer difficult. Existing adaptation strategies often compress, select, or reshape the original spectra to match model-specific input requirements. These operations may discard useful spectral information and weaken local spectral continuity. To address this problem, we propose MBTI, a Multi-Branch efficient fine-tuning framework for Hyperspectral Image classification. MBTI adapts hyperspectral foundation models to downstream classification tasks while preserving full-band spectral information. First, we introduce a spectral-continuity-preserving multi-branch preprocessing strategy. The original HSI is divided into multiple continuous spectral subsets, and a band reuse mechanism is used when the remaining bands cannot form a complete branch. This avoids invalid padding and unnecessary spectral loss. Second, independent Low-Rank Adaptation (LoRA) modules are inserted into each branch. They enable different spectral intervals to learn task-specific discriminative features while keeping most pre-trained parameters frozen. Finally, a multi-branch channel attention fusion module adaptively recalibrates and integrates features from all spectral branches. Experiments on three public hyperspectral datasets show that MBTI achieves competitive and superior performance compared with representative classification methods. Under the final rank-8 configuration, only about 2.33\%--2.36\% of the parameters are trainable. The code will be available at https://github.com/Azhenmiddleblock/MBTI/tree/main.
