Search papers, labs, and topics across Lattice.
This paper introduces a new Infrared-Visible Maritime Ship Dataset (IVMSD) to address the lack of realistic maritime data for degraded image restoration and segmentation. They propose a Multi-task Complementary Learning Framework (MCLF) that unifies image restoration, multimodal fusion, and semantic segmentation. The MCLF incorporates Frequency-Spatial Enhancement Complementary (FSEC) and Semantic-Visual Consistency Attention (SVCA) modules, achieving state-of-the-art segmentation performance on the IVMSD dataset.
Achieve robust maritime scene segmentation by jointly learning restoration, fusion, and segmentation, outperforming prior methods in complex, degraded conditions.
Marine scene understanding and segmentation plays a vital role in maritime monitoring and navigation safety. However, prevalent factors like fog and strong reflections in maritime environments cause severe image degradation, significantly compromising the stability of semantic perception. Existing restoration and enhancement methods typically target specific degradations or focus solely on visual quality, lacking end-to-end collaborative mechanisms that simultaneously improve structural recovery and semantic effectiveness. Moreover, publicly available infrared-visible datasets are predominantly collected from urban scenes, failing to capture the authentic characteristics of coupled degradations in marine environments. To address these challenges, the Infrared-Visible Maritime Ship Dataset (IVMSD) is proposed to cover various maritime scenarios under diverse weather and illumination conditions. Building upon this dataset, a Multi-task Complementary Learning Framework (MCLF) is proposed to collaboratively perform image restoration, multimodal fusion, and semantic segmentation within a unified architecture. The framework includes a Frequency-Spatial Enhancement Complementary (FSEC) module for degradation suppression and structural enhancement, a Semantic-Visual Consistency Attention (SVCA) module for semantic-consistent guidance, and a cross-modality guided attention mechanism for selective fusion. Experimental results on IVMSD demonstrate that the proposed method achieves state-of-the-art segmentation performance, significantly enhancing robustness and perceptual quality under complex maritime conditions.
