Search papers, labs, and topics across Lattice.
This paper introduces KILVO, a robust kinematic-inertial-LiDAR-visual odometry framework specifically designed for humanoid robots, leveraging a hybrid error-state iterated Kalman filter (ESIKF) to integrate data from joint encoders, IMUs, LiDAR, and cameras. By employing asynchronous processing for leg kinematics and sequential updates for exteroceptive data, KILVO enhances accuracy and resilience to sensor failures compared to existing methods. Extensive experiments demonstrate that KILVO achieves superior performance in accuracy, efficiency, and robustness across various humanoid robots and scenarios, making it a significant advancement in robotic odometry.
KILVO outperforms state-of-the-art fusion methods, achieving high accuracy and robustness even in the face of sensor failures.
This article presents a kinematic-inertial-LiDAR-visual odometry for humanoid robots, called KILVO. Tailored to the platform features, requirements, and real-world complexity, it fully utilizes the sensors commonly equipped on humanoid robots, including joint encoders, IMU, LiDAR, and camera, within an asynchronous-sequential hybrid error-state iterated Kalman filter (ESIKF). Specifically, inertial data are used for prediction, leg kinematics are processed asynchronously at a high rate and provide proprioceptive constraints, while exteroception is updated sequentially, first by registering LiDAR points for geometric priors and then by updating the visual component via photometric errors. Moreover, the framework is elaborately designed with multimodal adaptation for resilience to sensor failures. A compact contact estimation module is also developed, sharing information with state estimation without additional sensors. Extensive experiments on public datasets and in the real world across multiple humanoid robots, gait patterns, and scenarios demonstrate that KILVO achieves highly competitive accuracy, efficiency, and output rates, with strong robustness against sensor degradation and failures, making it more suitable for humanoid robots than state-of-the-art fusion methods. Our code and datasets are released on GitHub.
