Search papers, labs, and topics across Lattice.
This paper introduces TRIG, a novel framework for metric geometry learning in autonomous driving that decouples ego-motion and camera-rig geometry to enhance pose estimation and depth prediction. By factorizing camera poses into distinct components, TRIG allows for more effective utilization of vehicle-side geometric priors and improves the modeling of static multi-camera systems. Experimental results across five benchmarks demonstrate that TRIG achieves state-of-the-art performance in key tasks such as pose estimation, metric depth prediction, and 3D reconstruction.
Decoupling ego-motion from camera-rig geometry leads to unprecedented accuracy in pose estimation and depth prediction for autonomous driving systems.
Vision-centric autonomous driving requires accurate metric geometry and ego-motion estimation from synchronized multi-camera observations. Recent visual geometry models show strong performance in pose estimation, depth prediction, and 3D reconstruction, but are not tailored to rigid multi-camera driving systems. They often encode camera poses as entangled representations, in which time-varying ego-motion and static camera-rig geometry are jointly modeled, limiting the utilization of vehicle-side geometric priors. We propose Trajectory-Rig Decoupled Metric Geometry Learning (TRIG), a geometry perception framework for autonomous driving. TRIG factorizes camera poses into ego-trajectory and camera-rig components, enabling separate modeling of ego-motion and static multi-camera topology. We introduce decoupled pose encoding and supervision, which separately constrain trajectory evolution and rig geometry for metric-consistent learning. Moreover, sparse Temporal--Spatial attention separates cross-camera interaction from temporal aggregation, reducing global attention cost while preserving geometric reasoning. Experiments on five autonomous driving benchmarks show that TRIG achieves state-of-the-art performance in pose estimation, metric depth prediction, and 3D reconstruction.
