Search papers, labs, and topics across Lattice.
This paper introduces the Information Bottleneck-driven High-Fidelity Network (IB-HFN) for enhancing cloud removal in optical remote sensing images using synthetic aperture radar (SAR) data. By employing a dual-stream backbone and a Spatial Information Bottleneck Fusion module, the method effectively mitigates SAR speckle noise while preserving essential surface details. Experimental results on the SEN12MS-CR dataset reveal that IB-HFN significantly outperforms existing multimodal fusion techniques in terms of structural preservation and spectral fidelity.
Achieving high-fidelity cloud removal, IB-HFN outperforms traditional methods by effectively decoupling noise suppression from texture preservation.
Synthetic aperture radar (SAR)-assisted optical cloud removal aims to recover surface information obscured by clouds in optical remote sensing images by exploiting complementary SAR observations. Existing multimodal fusion methods typically rely on direct spatial concatenation and pixel-wise supervision, which can propagate SAR speckle noise into optical reconstruction and lead to over-smoothed results. To address these limitations, we propose an Information Bottleneck-driven High-Fidelity Network (IB-HFN) for SAR-assisted optical cloud removal. IB-HFN employs a dual-stream backbone to preserve modality-specific representations before deep semantic fusion, thereby mitigating premature cross-modal contamination. At the fusion stage, we introduce a Spatial Information Bottleneck Fusion module that compresses SAR features through a channel-wise variational information bottleneck to suppress unstructured speckle noise. In parallel, a local-global gating mechanism predicts clear-sky regions and routes reliable optical details through a Dirac-initialized skip connection, decoupling noise suppression from texture preservation. We further develop a joint optimization strategy that integrates feature-level bottleneck regularization with image-level constraints on reconstruction accuracy, structural consistency, spectral fidelity, and contrastive sharpness. A dynamic weighting schedule balances these objectives to stabilize training and reduce hazy artifacts. Experiments on the SEN12MS-CR dataset under challenging spatio-temporal splits demonstrate that IB-HFN achieves superior structural preservation and spectral fidelity over existing methods.
