Search papers, labs, and topics across Lattice.
This paper introduces PGU-Net, a physics-guided deep unfolding network designed for blind cross-sensor spectral super-resolution (SSR) that jointly estimates hyperspectral images (HSIs) and a learnable spectral transformation function (STF). By unrolling an alternating optimization process into an end-to-end trainable architecture, PGU-Net effectively addresses the challenges posed by unknown spectral degradation in practical applications. Experimental results on benchmark datasets and real UAV data demonstrate significant improvements in HSI reconstruction accuracy compared to existing SSR methods, highlighting the model's robustness and interpretability.
Blind cross-sensor spectral super-resolution can achieve unprecedented accuracy by learning the spectral transformation function directly from data, rather than relying on fixed assumptions.
Hyperspectral imaging provides rich spectral information for quantitative remote sensing, yet hyperspectral sensors remain costly and thus unavailable in many UAV deployments. Spectral super-resolution (SSR) seeks to reconstruct hyperspectral images (HSIs) from multispectral images (MSIs). Most existing SSR methods assume a fixed and known spectral response function (SRF) and are therefore limited to single-sensor settings. In practical cross-sensor scenarios, the spectral degradation from HSI to MSI is unknown and varies with sensor characteristics and scene content, which renders HSI reconstruction ill-posed. This paper proposes a physics-guided deep unfolding network, termed PGU-Net, to address blind cross-sensor SSR by jointly estimating the HSI and a learnable spectral transformation function (STF). PGU-Net unrolls an alternating optimization procedure into an end-to-end trainable architecture with stages, where each stage sequentially updates the HSI and the STF. Both modules combine learnable proximal networks with differentiable closed-form solvers, enabling physical interpretability while retaining strong representation capacity. Experiments on benchmark datasets (CAVE and NTIRE 2022) with multiple SRFs demonstrate accurate recovery of the STF (degradation operator) and improved reconstruction performance over state-of-the-art SSR methods. Furthermore, evaluations on a real UAV cross-sensor dataset (Headwall Nano HSI and DJI P4 Multispectral MSI) verify the effectiveness and robustness of PGU-Net under truly blind conditions, and suggest that the estimated STF may exhibit land-cover-related differences.
