Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the necessity of deeper learning in visual-inertial odometry (VIO) for robust performance under distribution shifts, revealing that enhanced robustness can be achieved by limiting learning to visual measurement generation. The authors introduce a minimal-learning stereo VIO framework utilizing SEA-RAFT for dense stereo correspondence proposals while maintaining explicit geometric verification and state estimation. Experimental results across various datasets demonstrate that the combination of learned visual measurements with geometric verification significantly outperforms traditional learning-dominant approaches, highlighting a more effective strategy for out-of-distribution robustness in VIO systems.
Learning visual measurements can outperform deeper learning in VIO, challenging the assumption that more learning always leads to better robustness under distribution shifts.
Learning is increasingly introduced into visual-inertial odometry (VIO), ranging from learned feature front-ends to learning-dominant motion and geometry estimation. However, learning more of the pipeline does not necessarily improve robustness when deployment conditions differ from the training distribution. This work asks whether robust VIO under distribution shift truly requires deeper learned estimation, or whether learning can be confined to visual measurement generation. We propose a minimal-learning stereo VIO framework in which SEA-RAFT is used only to propose dense stereo correspondences and predict their uncertainty, while temporal tracking, geometric verification, and state estimation remain explicit. Dense flow is sampled at sparse feature locations, filtered using predicted uncertainty and stereo epipolar consistency, and incorporated into a sliding-window stereo-inertial estimator through uncertainty-weighted reprojection factors. The same uncertainty is further propagated through stereo triangulation for downstream anisotropic 3D Gaussian mapping. Experiments on EuRoC, VIODE, and 4Seasons demonstrate accurate and stable estimation under motion blur, dynamic scenes, illumination changes, and large indoor-to-outdoor distribution shifts. Ablations show that learned flow alone is insufficient: the gains arise from combining learned correspondence proposals with geometric verification and uncertainty-aware weighting. These results suggest that, for OOD-robust VIO, carefully integrated learned visual measurements can be more effective than learning a larger fraction of the estimation pipeline. Code and configs for the benchmark will be open-source upon acceptance. A supplementary video is available at https://drive.google.com/file/d/1EVRhOkhanmNXHbQS1Vr80FoEIAYOYOV2/view