Search papers, labs, and topics across Lattice.
This paper introduces Argus, a feed-forward network designed for metric panoramic 3D reconstruction, trained on the newly created Realsee3D dataset comprising 10,000 indoor scenes. The key innovation lies in a learned covisibility module that optimally selects reference views to mitigate global pose drift in sparse unordered captures. Argus achieves state-of-the-art performance in camera pose estimation, depth estimation, and point cloud reconstruction, demonstrating significant advancements in the field of 3D reconstruction from panoramic data.
A learned covisibility module in Argus effectively eliminates global pose drift, setting a new benchmark for 3D reconstruction accuracy in indoor scenes.
Metric feed-forward 3D reconstruction for panoramic data remains under-explored due to the lack of large-scale panoramic RGB-D training data. We present Realsee3D, a hybrid dataset of 10K indoor scenes (1K real, 9K synthetic) with 299K panoramic viewpoints and precise metric annotations, and Argus, a feed-forward network trained on it for metric panoramic 3D reconstruction. In the sparse unordered capture setting of Realsee3D, a poorly chosen coordinate anchor can cause global pose drift. Argus addresses this with a learned covisibility module that selects the geometrically optimal reference view to anchor the metric world frame. To further improve multi-task learning, we decompose the bidirectional pixel-to-world mapping into interpretable sub-steps with per-step supervision and cross-coordinate joint constraints, reinforcing geometric consistency across prediction branches. On the Realsee3D benchmark, Argus achieves state-of-the-art metric performance in camera pose estimation, depth estimation, and point cloud reconstruction. Project page: https://argus-paper.realsee.ai.
