Search papers, labs, and topics across Lattice.
RAFT-MSF++ extends monocular scene flow estimation to multi-frame inputs by recurrently fusing temporal features to jointly estimate depth and scene flow in a self-supervised manner. The core innovation is the Geometry-Motion Feature (GMF), which encodes coupled motion and geometry cues and is iteratively updated. To improve robustness, they incorporate relative positional attention and occlusion regularization, achieving a 30.99% improvement over the baseline on the KITTI Scene Flow benchmark.
Multi-frame monocular scene flow estimation gets a serious boost with RAFT-MSF++, which uses Geometry-Motion Feature fusion to achieve state-of-the-art results and improved robustness to occlusions.
Monocular scene flow estimation aims to recover dense 3D motion from image sequences, yet most existing methods are limited to two-frame inputs, restricting temporal modeling and robustness to occlusions. We propose RAFT-MSF++, a self-supervised multi-frame framework that recurrently fuses temporal features to jointly estimate depth and scene flow. Central to our approach is the Geometry-Motion Feature (GMF), which compactly encodes coupled motion and geometry cues and is iteratively updated for effective temporal reasoning. To ensure the robustness of this temporal fusion against occlusions, we incorporate relative positional attention to inject spatial priors and an occlusion regularization module to propagate reliable motion from visible regions. These components enable the GMF to effectively propagate information even in ambiguous areas. Extensive experiments show that RAFT-MSF++ achieves 24.14% SF-all on the KITTI Scene Flow benchmark, with a 30.99% improvement over the baseline and better robustness in occluded regions. The code is available at https://github.com/sunzunyi/RAFT-MSF-PlusPlus.
