Search papers, labs, and topics across Lattice.
GeoWeaver introduces a unified framework for long-sequence 3D reconstruction that integrates a Geometric Prior Model (GPM) with Test-Time Adaptation (TTA) to enhance accuracy and consistency in camera motion and depth estimation. By leveraging chunk-wise processing and dense correspondences, the method effectively mitigates issues such as scale drift and pose errors that are common in independently predicted segments. Experimental results across various benchmarks show significant improvements in camera accuracy, global consistency, and point-cloud quality, validating the robustness of the approach across different geometric prior models.
GeoWeaver achieves unprecedented accuracy in long-sequence 3D reconstruction by correcting accumulated errors through a novel combination of geometric priors and adaptive refinement techniques.
Long-sequence 3D reconstruction from RGB videos requires both accurate local geometry and globally consistent camera motion. Feed-forward models provide strong depth and pose predictions, but their memory cost prevents joint inference over long sequences. Chunk-wise processing improves scalability, yet independently predicted chunks often exhibit scale drift, pose errors, and point-cloud misalignment. We present GeoWeaver, a unified framework comprising a Geometric Prior Model (GPM) and Test-Time Adaptation (TTA). The GPM predicts chunk-wise depth, confidence, and camera parameters as adjustable geometric priors. TTA then performs sequential initialization, global chunk-level Sim(3) alignment, and coarse-to-fine refinement of camera poses, affine depth corrections, and intrinsics. Dense correspondences provide adjacent, cross-chunk, and long-range constraints, while a robust CDF-style objective jointly optimizes weighted 2D reprojection and 3D consistency residuals. This design preserves local geometric accuracy while correcting accumulated pose, scale, depth, and calibration errors. Experiments across diverse long-sequence benchmarks demonstrate improved camera accuracy, global consistency, and point-cloud quality. Ablations verify the contribution of each adaptation stage, and applying the same TTA procedure to different geometric prior models consistently improves their trajectory estimates, demonstrating that GeoWeaver is not tied to a specific GPM.
Tsinghua AI