Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Completion-Assisted Object-CAD Alignment (CAOA), a novel approach that combines a point cloud completion module with a symmetry-aware pose estimation algorithm to improve the alignment of CAD models with objects in noisy indoor RGB-D scans. By addressing the challenges posed by segmentation errors and geometric distortions, CAOA significantly enhances the accuracy of object alignment, achieving a 17% improvement over existing methods on the Scan2CAD benchmark. The authors also present a synthetic data generation strategy and the S2C-Completion dataset, which bridges the gap between synthetic and real-world data, facilitating better model generalization.
Achieving a 17% accuracy boost in CAD model alignment by leveraging symmetry-aware techniques and a novel dataset tailored for real-world indoor scenes.
Accurately aligning CAD models to their corresponding objects in indoor RGB-D scans is a central challenge in 3D semantic reconstruction. The task requires estimating a 9-Degree-of-Freedom (DoF) pose-position, rotation, and scale along three axes-but is hindered by noisy and incomplete scans, as well as segmentation errors that cause geometric distortions. We present Completion-Assisted Object-CAD Alignment (CAOA), a method that integrates a semantically and contextually aware point cloud completion module with a symmetry-aware relative pose estimation algorithm, enabling precise alignment of CAD models to scanned objects. Existing completion methods are typically trained and evaluated on synthetic datasets, which often fail to generalize to real-world scans. To bridge this gap, we introduce a synthetic data generation strategy tailored to indoor scenes, significantly reducing the synthetic-to-real domain gap-validated through quantitative comparisons with widely used completion datasets. In addition, we release S2C-Completion, an expert-annotated dataset of over 8,500 object-CAD pairs from Scan2CAD, created for real-world indoor single-object completion and intended as a new benchmark for this task. For object-CAD alignment, we incorporate symmetry information via a symmetry-aware loss, improving robustness to symmetric ambiguities. On the Scan2CAD benchmark, CAOA achieves a 17% accuracy improvement over state-of-the-art methods.