Search papers, labs, and topics across Lattice.
The paper introduces UniScale, a unified framework for scale-aware multi-view 3D reconstruction that jointly estimates camera parameters, depth maps, and scene scale from multi-view images. UniScale leverages a single feed-forward network with camera-aware feature representations to recover metric scale, optionally incorporating geometric priors such as known camera intrinsics or poses to improve performance. The method demonstrates strong generalization across diverse environments without requiring training from scratch, instead leveraging priors from pre-existing models.
Achieve robust, metric-aware 3D reconstruction from multi-view images with a single feed-forward network that flexibly incorporates geometric priors, even without retraining.
We present UniScale, a unified, scale-aware multi-view 3D reconstruction framework for robotic applications that flexibly integrates geometric priors through a modular, semantically informed design. In vision-based robotic navigation, the accurate extraction of environmental structure from raw image sequences is critical for downstream tasks. UniScale addresses this challenge with a single feed-forward network that jointly estimates camera intrinsics and extrinsics, scale-invariant depth and point maps, and the metric scale of a scene from multi-view images, while optionally incorporating auxiliary geometric priors when available. By combining global contextual reasoning with camera-aware feature representations, UniScale is able to recover the metric-scale of the scene. In robotic settings where camera intrinsics are known, they can be easily incorporated to improve performance, with additional gains obtained when camera poses are also available. This co-design enables robust, metric-aware 3D reconstruction within a single unified model. Importantly, UniScale does not require training from scratch, and leverages world priors exhibited in pre-existing models without geometric encoding strategies, making it particularly suitable for resource-constrained robotic teams. We evaluate UniScale on multiple benchmarks, demonstrating strong generalization and consistent performance across diverse environments. We will release our implementation upon acceptance.
