Search papers, labs, and topics across Lattice.
The paper introduces Motion Integration DETR (MI-DETR), a novel infrared small target detector that explicitly models motion using a bio-inspired dual-pathway architecture. MI-DETR leverages a retina-inspired cellular automaton (RCA) to convert raw frame sequences into motion maps, enabling separate appearance and motion pathways supervised by a single set of bounding boxes. Experiments on three ISTD benchmarks demonstrate that MI-DETR achieves state-of-the-art performance, significantly outperforming existing multi-frame baselines, suggesting that explicit motion modeling enhances small target detection.
By explicitly modeling motion with a retina-inspired mechanism, MI-DETR achieves a remarkable +26.35 mAP@50 improvement over the best multi-frame baseline for infrared small target detection.
Infrared small target detection (ISTD) is challenging because tiny, low-contrast targets are easily obscured by complex and dynamic backgrounds. Conventional multi-frame approaches typically learn motion implicitly through deep neural networks, often requiring additional motion supervision or explicit alignment modules. We propose Motion Integration DETR (MI-DETR), a bio-inspired dual-pathway detector that processes one infrared frame per time step while explicitly modeling motion. First, a retina-inspired cellular automaton (RCA) converts raw frame sequences into a motion map defined on the same pixel grid as the appearance image, enabling parvocellular-like appearance and magnocellular-like motion pathways to be supervised by a single set of bounding boxes without extra motion labels or alignment operations. Second, a Parvocellular-Magnocellular Interconnection (PMI) Block facilitates bidirectional feature interaction between the two pathways, providing a biologically motivated intermediate interconnection mechanism. Finally, a RT-DETR decoder operates on features from the two pathways to produce detection results. Surprisingly, our proposed simple yet effective approach yields strong performance on three commonly used ISTD benchmarks. MI-DETR achieves 70.3% mAP@50 and 72.7% F1 on IRDST-H (+26.35 mAP@50 over the best multi-frame baseline), 98.0% mAP@50 on DAUB-R, and 88.3% mAP@50 on ITSDT-15K, demonstrating the effectiveness of biologically inspired motion-appearance integration. Code is available at https://github.com/nliu-25/MI-DETR.
