Search papers, labs, and topics across Lattice.
This paper introduces the Asymmetric Dual-text Guided Network (ADGNet) for infrared small target detection, addressing the limitations of existing multimodal methods that fail to effectively differentiate targets from clutter due to a lack of regional guidance and the challenges posed by infrared semantic asymmetry. By employing an Asymmetric Dual-text Prompt (ADP) that includes both abstract target and detailed background prompts, ADGNet utilizes an Asymmetric Dual-Branch Interaction (ADBI) module to enhance feature guidance and background suppression. Experimental results show that ADGNet significantly outperforms 21 state-of-the-art methods, highlighting its effectiveness in improving detection accuracy in cluttered environments.
ADGNet achieves superior infrared small target detection by leveraging asymmetric text prompts that enhance feature guidance and background suppression, outperforming 21 state-of-the-art methods.
InfRared Small Target Detection (IRSTD) is a challenging task. Relying solely on pixel-level information, vision-only methods struggle to distinguish targets from clutter. Current multimodal methods typically describe both targets and backgrounds with a single textual prompt. Such an approach lacks dedicated regional guidance and ignores infrared semantic asymmetry. Consequently, it provides insufficient background suppression information and introduces severe feature optimization conflicts, overwhelming small targets with noise. To address these issues, we propose a novel Asymmetric Dual-text Guided Network (ADGNet). Specifically, accounting for the infrared semantic asymmetry, we first design the Asymmetric Dual-text Prompt (ADP), comprising an image-agnostic abstract target prompt and an image-specific detailed background prompt. To leverage these prompts, we introduce an Asymmetric Dual-Branch Interaction (ADBI) module to separately guide visual features with their respective text priors, protecting targets from noise while suppressing background clutter. Subsequently, we introduce an Adaptive Feature Aggregation (AFA) module to dynamically fuse features from the two branches. Furthermore, we construct a multimodal Asymmetric Image-Text Infrared (AITIR) dataset by providing asymmetric text annotations for three public datasets (IRSTD-1K, NUDT-SIRST, and SIRST). Extensive experiments demonstrate that ADGNet outperforms 21 state-of-the-art (SOTA) methods. Code is available at https://github.com/iLearn-Lab/MM26-ADGNet.