Search papers, labs, and topics across Lattice.
This paper introduces SA-LIVO, an innovative LiDAR-inertial-visual odometry system that enhances performance by addressing the limitations of existing methods in handling sensor degeneracy. By employing a Subspace-Aware Information Fusion (SAIF) framework, the system selectively fuses information based on the direction of the joint information matrix, optimizing the use of visual data only when LiDAR is deficient. Experimental results demonstrate that SA-LIVO achieves competitive accuracy and significantly lower computational costs compared to state-of-the-art systems, making it suitable for real-time applications on resource-constrained devices.
SA-LIVO achieves competitive accuracy while operating 3.6-6.3x more efficiently in memory usage than existing LiDAR-visual odometry systems.
Tightly coupled LiDAR-visual-inertial odometry (LIVO) fuses precise geometric depth with complementary visual measurements, yet its exteroceptive sensors face independent failure modes: LiDAR degenerates when scan geometry is under-constrained, while visual measurements degrade under adverse illumination or texture absence. Existing countermeasures, including binary degeneracy detection, covariance inflation, and scene-level quality gating, operate at the modality level and leave the direction-dependent structure of the joint information matrix unaddressed. Consequently, visual residuals enter pose directions where LiDAR is well-constrained, while in deficient directions visual compensation disperses across the full state space rather than concentrating where needed. We propose SA-LIVO, a LiDAR-inertial-visual odometry system addressing these limitations through direction-selective fusion and information-efficient processing. The Subspace-Aware Information Fusion (SAIF) framework eigendecomposes the joint LiDAR-visual information matrix and applies a linear-clamp soft gate per eigendirection, attenuating degenerate directions while preserving observable ones at full strength. LiDAR and visual residuals are then jointly optimized in one InEKF loop at a shared linearization point. Since visual information contributes only where LiDAR is deficient, photometric Jacobians are assembled once before the loop and reused across iterations, avoiding the per-iteration cost of conventional iterated filters. Experiments on 29 sequences from three benchmarks (HILTI'22, New College, Oxford Spires) and concurrent-degradation scenarios show accuracy competitive with the strongest baselines and bounded drift where competing systems diverge. SA-LIVO averages 12.3 ms per frame on a laptop CPU and 26.8 ms on an embedded ARM board without GPU, with 3.6-6.3x lower peak memory. The code will be open-sourced.
