Search papers, labs, and topics across Lattice.
This paper introduces DROID-SLAM, a real-time RGB SLAM system robust to dynamic environments. It achieves this robustness by estimating per-pixel uncertainty based on multi-view visual feature inconsistency, which informs a differentiable Uncertainty-aware Bundle Adjustment. The system demonstrates state-of-the-art performance in camera pose estimation and scene geometry reconstruction in cluttered, dynamic scenarios while running at approximately 10 FPS.
DROID-SLAM achieves robust real-time RGB SLAM in dynamic environments by explicitly modeling per-pixel uncertainty, outperforming existing methods that struggle with unknown dynamic objects and cluttered scenes.
We present a robust, real-time RGB SLAM system that handles dynamic environments by leveraging differentiable Uncertainty-aware Bundle Adjustment. Traditional SLAM methods typically assume static scenes, leading to tracking failures in the presence of motion. Recent dynamic SLAM approaches attempt to address this challenge using predefined dynamic priors or uncertainty-aware mapping, but they remain limited when confronted with unknown dynamic objects or highly cluttered scenes where geometric mapping becomes unreliable. In contrast, our method estimates per-pixel uncertainty by exploiting multi-view visual feature inconsistency, enabling robust tracking and reconstruction even in real-world environments. The proposed system achieves state-of-the-art camera poses and scene geometry in cluttered dynamic scenarios while running in real time at around 10 FPS. Code and datasets are available at https://github.com/MoyangLi00/DROID-W.git.
