Search papers, labs, and topics across Lattice.
The authors introduce IRON, a large-scale multispectral (infrared and RGB) dataset with 24,314 densely annotated frames for off-road temporal freespace detection under all-day conditions. They also propose IRONet, a novel flow-free framework that uses a memory-attention mechanism and mask decoder to aggregate historical context and address inter-frame inconsistencies. Experiments show IRONet achieves state-of-the-art performance on the IRON dataset and generalizes well to RGB modalities on other datasets.
Nighttime off-road driving just got a whole lot safer: a new dataset and method overcome the limitations of visible-light perception by leveraging infrared data and temporal context.
Off-road nighttime autonomous driving suffers from unreliable visible-light perception, making infrared modality crucial for accurate freespace detection. However, progress remains limited due to the scarcity of annotated infrared off-road datasets and the inter-frame inconsistencies inherent to current single-frame methods. To address these gaps, we present the IRON dataset, which, to our knowledge, is the first large-scale infrared dataset for off-road temporal freespace detection under all-day conditions, with strong support for nighttime perception. The dataset comprises 24,314 densely annotated infrared images with synchronized RGB images in diverse scenes and different light conditions. Building upon this dataset, we propose IRONet, a novel flow-free framework for temporal freespace detection that addresses inter-frame inconsistencies by aggregating historical context via a memory-attention mechanism and a carefully designed mask decoder. On our IRON dataset, IRONet achieves state-of-the-art performance, reaching 82.93%(+1.19%) IoU and 90.66%(+0.71%) F1 score at real-time inference. Remarkably, IRONet also exhibits robust generalization to RGB modalities on ORFD and Rellis datasets. Overall, our work establishes a foundation for reliable all-day off-road autonomous driving and future research in infrared temporal perception. The code and IRON dataset are available at https://github.com/wsnbws/IRON.
