Search papers, labs, and topics across Lattice.
The paper introduces USP-Mamba, a novel framework for hyperspectral image super-resolution that enhances reconstruction quality by integrating unmixing-derived spectral prompts and image-dependent structural prompts. This approach addresses the limitations of traditional Mamba models, which disrupt spatial adjacency and rely on generic representations, by incorporating composition-aware spectral priors that ensure contextual information is effectively propagated. Experimental results show that USP-Mamba significantly outperforms existing methods across various datasets, highlighting its potential for preserving both spectral and spatial fidelity in hyperspectral imaging.
By leveraging unmixing-informed spectral prompts, USP-Mamba achieves superior hyperspectral image reconstruction while maintaining spatial continuity and contextual integrity.
Hyperspectral image super-resolution aims to reconstruct high-resolution imagery while preserving dense spectral information. Recently, Mamba-based models have shown promising potential for this task by capturing long-range dependencies with linear computational complexity. Nevertheless, their causal sequence modeling requires two-dimensional hyperspectral features to be unfolded along predefined scanning orders, which disrupts spatial adjacency and restricts the effective propagation of contextual information. Moreover, state-space parameterization of existing models is predominantly derived from generic learned representations, without explicit alignment with the intrinsic characteristics of the hyperspectral image. To address this issue, we propose an Unmixing-derived Spectral and Structural Prompting Mamba framework, termed USP-Mamba, which adapts Mamba state evolution through composition-aware spectral priors and image-dependent structural prompts. Specifically, an unmixing-informed spectral prompt captures the global material composition of the input image and provides persistent conditioning throughout reconstruction. Injected into the Mamba sequence and progressively adapted across layers, it steers state evolution toward composition-consistent reconstruction. We introduce feature-level structural prompts comprising spatial and frequency components to provide image-dependent local guidance. The spatial prompt promotes structure-sensitive state encoding for local detail preservation, while the frequency prompt enables region-adaptive transitions between homogeneous regions and high-frequency details. Finally, complementary Hilbert and Semantic-Guided Neighboring scans preserve spatial continuity and strengthen non-local semantic dependency modeling. Extensive experiments on different datasets demonstrate that the proposed method consistently outperforms representative approaches.
