Search papers, labs, and topics across Lattice.
This paper introduces Pan-TCR, a unified end-to-end framework for pansharpening thin-cloud contaminated remote sensing images, addressing the limitations of sequential cloud removal and pansharpening approaches. The core of Pan-TCR is a frequency-decoupled restoration (FDR) block that disentangles multispectral image (MSI) feature restoration into amplitude and phase components, guided by near-infrared (NIR) band amplitude and panchromatic (PAN) phase respectively, along with an interactive inter-frequency consistency (IFC) module. The authors also contribute PanTCR-GF2, the first real-world thin-cloud contaminated pansharpening dataset, and demonstrate Pan-TCR's superior performance on both real and synthetic data.
Achieve state-of-the-art pansharpening of thin-cloud contaminated remote sensing images with a unified model that disentangles frequency components and leverages NIR and PAN bands for robust restoration.
Pansharpening under thin cloudy conditions is a practically significant yet rarely addressed task, challenged by simultaneous spatial resolution degradation and cloud-induced spectral distortions. Existing methods often address cloud removal and pansharpening sequentially, leading to cumulative errors and suboptimal performance due to the lack of joint degradation modeling. To address these challenges, we propose a Unified Pansharpening Model with Thin Cloud Removal (Pan-TCR), an end-to-end framework that integrates physical priors. Motivated by theoretical analysis in the frequency domain, we design a frequency-decoupled restoration (FDR) block that disentangles the restoration of multispectral image (MSI) features into amplitude and phase components, each guided by complementary degradation-robust prompts: the near-infrared (NIR) band amplitude for cloud-resilient restoration, and the panchromatic (PAN) phase for high-resolution structural enhancement. To ensure coherence between the two components, we further introduce an interactive inter-frequency consistency (IFC) module, enabling cross-modal refinement that enforces consistency and robustness across frequency cues. Furthermore, we introduce the first real-world thin-cloud contaminated pansharpening dataset (PanTCR-GF2), comprising paired clean and cloudy PAN-MSI images, to enable robust benchmarking under realistic conditions. Extensive experiments on real-world and synthetic datasets demonstrate the superiority and robustness of Pan-TCR, establishing a new benchmark for pansharpening under realistic atmospheric degradations.
