Search papers, labs, and topics across Lattice.
This paper introduces the Joint Feature-domain Registration and Detection network (JFRDet), which addresses severe cross-modal geometric misalignment in visible-infrared object detection by implementing a Cross-Modal Affine Alignment (CMAA) module for explicit feature alignment. The method further enhances detection reliability under varying illumination conditions through an Illumination-Guided Complementary Fusion (IGCF) module and stabilizes optimization with an Alignment Quality-Consistency Gating (AQCG) strategy. JFRDet achieves a state-of-the-art performance of 69.7% mAP50 on the newly constructed DroneVehicle Misaligned (DVMA) benchmark, showcasing its effectiveness in challenging scenarios.
JFRDet achieves state-of-the-art performance in visible-infrared object detection by explicitly addressing severe geometric misalignment and illumination variability.
Visible-infrared object detection relies on complementary RGB and thermal cues, but its performance is often degraded by cross-modal spatial misalignment. Most existing methods rely on implicit feature adaptation to handle weakly misaligned scenarios, while large-offset geometric discrepancies remain insufficiently addressed. In this paper, we propose a Joint Feature-domain Registration and Detection network (JFRDet), an end-to-end visible-infrared oriented object detector tailored for severely cross-modal geometric discrepancies. JFRDet introduces a Cross-Modal Affine Alignment (CMAA) module to estimate an image-level affine transformation for explicit multi-level feature alignment. Note that illumination changes directly affect the reliability of RGB cues, an Illumination-Guided Complementary Fusion (IGCF) module adaptively exploits modality reliability under varying illumination conditions for cross-modal fusion. Then, an Alignment Quality-Consistency Gating (AQCG) strategy stabilizes joint optimization by modulating detection supervision according to alignment reliability and gradient consistency. We further construct DroneVehicle Misaligned (DVMA), a benchmark for evaluating visible-infrared oriented object detection under severe cross-modal geometric misalignment. The proposed JFRDet achieves 69.7\% $\mathrm{mAP}_{50}$ on DVMA, which represents state-of-the-art (SOTA) performance. The code and dataset will be available on GitHub.
