Search papers, labs, and topics across Lattice.
This paper introduces I2PRef, a novel image-conditioned point cloud completion network that reconstructs complete point clouds directly from a single RGB image using an Image-to-Point (I2P) module. A subsequent Point-to-Point (P2P) refinement module, leveraging transformers with self- and cross-attention, iteratively refines the coarse I2P output by attending to both point tokens and image features. Experiments on ShapeNet-ViPC demonstrate a 12.3% relative Chamfer Distance improvement over existing state-of-the-art methods, indicating the effectiveness of the image-driven approach.
Ditching reliance on 3D inputs, I2PRef directly reconstructs complete and detailed point clouds from single RGB images, outperforming existing multimodal methods by 12.3% in Chamfer Distance.
We present an image-conditioned point cloud completion approach that treats images as the primary geometric source rather than a secondary guide. To this end, we introduce an Image-to-Point (I2P) module that can reconstruct complete point clouds directly from a single RGB image, with no need for 3D inputs. Additionally, we introduce a transformer-based Point-to-Point (P2P) refinement module that uses self- and cross-attention between point tokens and image features to iteratively refine the coarse I2P output. The I2P module enables the image encoder to learn rich geometric representations, while the P2P module progressively recovers fine-grained details. Unlike existing multimodal methods that rely on auxiliary losses or fusion modules, our explicit I2P task provides a strong, geometry-aware prior based on images alone. Extensive experiments on ShapeNet-ViPC demonstrate state-of-the-art completion performance with a 12.3% relative Chamfer Distance improvement over prior methods. Code is available at: https://github.com/AzharSindhi/I2PRef.git
