Search papers, labs, and topics across Lattice.
This paper introduces PL-LIT, a novel SLAM system that integrates LiDAR, inertial data, and thermal imaging to enhance tracking and state estimation in challenging conditions. By employing a deep neural network for point-line feature extraction and a tightly coupled Error-State Iterated Kalman Filter, PL-LIT overcomes the limitations of conventional optical flow methods that struggle with brightness constancy in thermal images. Experimental results show that PL-LIT not only achieves superior performance in long-range thermal datasets but also enables real-time thermal anomaly detection, making it a robust solution for safety inspections.
PL-LIT achieves state-of-the-art performance in thermal SLAM, even in challenging environments where traditional methods falter.
Thermal imaging is resilient to adverse conditions, such as intense illumination, low-light operation, and fog, and can therefore mitigate odometry degradation when visible-spectrum imagery becomes unreliable. Nevertheless, most thermal cameras employ automatic gain control (AGC), and thermal images often present low global contrast despite containing informative edge structures. These characteristics undermine brightness constancy and cause conventional optical flow tracking-based odometry pipelines that fundamentally rely on the brightness constancy assumption across consecutive frames. To address these issues, we propose a general LiDAR-Inertial-Thermal SLAM system that accommodates both visible-light and thermal cameras. PL-LIT combines an online photometric calibration module with a deep neural network for point-line feature extraction, enabling more stable and repeatable thermal tracking. For state estimation, we design a tightly coupled LiDAR-Inertial-Thermal formulation within an Error-State Iterated Kalman Filter (ESIKF). We further introduce a line-feature constraint scheme ensuring the reliability of geometric constraints across varying thermal appearances. In addition, PL-LIT builds a probabilistic thermal-intensity voxel map, which supports real-time thermal anomaly detection. Extensive experiments demonstrate that PL-LIT exhibits generality and robustness in visible-light environments, achieves state-of-the-art performance on long-range thermal infrared datasets, and provides practical safety inspection functionality based on thermographic mapping.
