Search papers, labs, and topics across Lattice.
This paper introduces MAGiSt3R, a multi-agent framework for 3D reconstruction from monocular RGB videos, achieving nearly 10 FPS performance. By utilizing a feed-forward model from the 3R family for local point map regression and a merging model called MAGMA for integrating maps across agents, MAGiSt3R effectively addresses the challenges of camera tracking and reconstruction accuracy. The framework's implementation includes pose graph optimization to reduce cumulative drift, resulting in superior performance against existing methods on both synthetic and real-world datasets.
MAGiSt3R achieves high-speed 3D reconstruction from monocular videos while significantly improving accuracy and mitigating camera drift.
This paper presents MAGiSt3R, a multi-agent 3D reconstruction framework performing reconstruction and camera tracking for monocular RGB videos at almost 10 FPS. MAGiSt3R relies on a feed-forward model from the 3R family to process RGB videos and regress local point maps, and on a merging model, MAGMA, that combines local maps at both intra-agent and inter-agent levels to obtain the final global point map. Furthermore, MAGiSt3R performs pose graph optimization to mitigate cumulative camera drift occurring along the feed-forward pipeline. We evaluate MAGiSt3R on both synthetic and real-world datasets, demonstrating its superior reconstruction and camera tracking accuracy compared to state-of-the-art approaches.
