Search papers, labs, and topics across Lattice.
This paper introduces MVOFormer, a transformer-based framework designed to enhance monocular visual odometry (MVO) by integrating dense geometric motion cues with object-centric semantic information. The architecture employs a Flow-Semantic Dual Branch Encoder to effectively differentiate between static structures and dynamic elements, followed by an Iterative Multimodal Decoder that refines pose estimates while minimizing attention on unreliable features. Extensive evaluations reveal that MVOFormer achieves remarkable zero-shot generalization and robustness across various benchmarks, outperforming existing frame-to-frame methods without requiring target-domain fine-tuning.
MVOFormer outperforms traditional learning-based MVO methods by achieving superior zero-shot generalization and robustness through a novel flow-semantic architecture.
Monocular visual odometry (MVO) is foundational to autonomous navigation and robotic localization. However, existing learning-based MVO approaches often struggle with either a lack of interpretable, complementary features or overly complex multi-stage architectures. These limitations inherently restrict their robustness and cross-domain generalization. In this work, we propose MVOFormer, a novel transformer framework for robust monocular visual odometry. Our architecture features a Flow-Semantic Dual Branch Encoder that synergizes dense geometric motion cues with object-centric semantic priors, explicitly distinguishing static structures from dynamic distractors. These representations are then fused by an Iterative Multimodal Decoder, enabling coarse-to-fine pose refinement while dynamically suppressing attention on unreliable regions. Extensive evaluations demonstrate that, without any target-domain fine-tuning, MVOFormer achieves superior zero-shot generalization and robustness, significantly outperforming prior learning-based frame-to-frame methods across diverse benchmarks including TartanAir, KITTI, TUM-RGBD, and ETH3D-SLAM.
