Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors introduce IRON, a large-scale multispectral (infrared and RGB) dataset with 24,314 densely annotated frames for off-road freespace detection under all-day lighting conditions. They also propose IRONet, a novel flow-free temporal freespace detection framework that uses a memory-attention mechanism to aggregate historical context and improve inter-frame consistency. Experiments on the IRON dataset demonstrate that IRONet achieves state-of-the-art performance in infrared freespace detection and generalizes well to RGB modalities on other datasets.
Nighttime off-road self-driving just got a boost: a new dataset and method robustly handles the dark by fusing infrared and RGB data with a novel memory-attention mechanism.
Off-road nighttime autonomous driving suffers from unreliable visible-light perception, making infrared modality crucial for accurate freespace detection. However, progress remains limited due to the scarcity of annotated infrared off-road datasets and the inter-frame inconsistencies inherent to current single-frame methods. To address these gaps, we present the IRON dataset, which, to our knowledge, is the first large-scale infrared dataset for off-road temporal freespace detection under all-day conditions, with strong support for nighttime perception. The dataset comprises 24,314 densely annotated infrared images with synchronized RGB images in diverse scenes and different light conditions. Building upon this dataset, we propose IRONet, a novel flow-free framework for temporal freespace detection that addresses inter-frame inconsistencies by aggregating historical context via a memory-attention mechanism and a carefully designed mask decoder. On our IRON dataset, IRONet achieves state-of-the-art performance, reaching 82.93%(+1.19%) IoU and 90.66%(+0.71%) F1 score at real-time inference. Remarkably, IRONet also exhibits robust generalization to RGB modalities on ORFD and Rellis datasets. Overall, our work establishes a foundation for reliable all-day off-road autonomous driving and future research in infrared temporal perception. The code and IRON dataset are available at https://github.com/wsnbws/IRON.