Search papers, labs, and topics across Lattice.
This paper introduces 3D Multi-Perspective Embedding (3DMPE), an optimization-based method for reconstructing 3D point clouds from multiple partially observed 2D projections without relying on training data. By leveraging cross-view point correspondences and visibility information, 3DMPE effectively handles missing points and incomplete distance data, outperforming traditional learning-based approaches. Experimental results on ShapeNet and Pix3D show that 3DMPE achieves high reconstruction quality across various noise conditions and projection settings, highlighting its robustness and versatility.
3DMPE reconstructs 3D point clouds from incomplete 2D views without the need for training data, setting a new standard for geometric reconstruction methods.
We study 3D point cloud reconstruction from multiple partially observed 2D projections. Given two or more projections of an unknown 3D point cloud, together with cross-view point correspondences and visibility information, our goal is to recover a consistent 3D configuration when different views contain different subsets of points. We propose 3D Multi-Perspective Embedding (3DMPE), an optimization-based, training-free method that reconstructs the 3D point cloud and, in the variable-projection setting, jointly estimates the projection maps. 3DMPE extends Multi-Perspective Simultaneous Embedding to accommodate missing points and incomplete pairwise distance information across views. We consider both fixed-projection and variable-projection settings. Unlike learning-based reconstruction methods that infer shape from raw images and often depend on training data, 3DMPE operates on geometric observations with established correspondences and does not require category-specific training. Experiments on ShapeNet and Pix3D evaluate reconstruction quality using Chamfer Distance, Earth Mover Distance, and RMSE-Optimize-Align (ROA), and examine the effects of initialization, the number of views, point visibility, and several noise regimes, including noisy distances and erroneous correspondences. The results demonstrate that 3DMPE can effectively reconstruct point clouds from partial multi-view geometric observations.
