Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces ArtPro, a self-supervised framework for reconstructing articulated objects using 3D Gaussian Splatting, addressing the sensitivity of existing methods to initial part segmentation. ArtPro leverages an over-segmentation initialization guided by geometry and motion priors to generate part proposals with plausible motion hypotheses. By dynamically merging these proposals based on motion consistency and employing collision-aware motion pruning, ArtPro achieves robust and accurate reconstruction of complex multi-part objects, outperforming existing methods in accuracy and stability on both synthetic and real-world datasets.
Ditch the brittle initial segmentation: ArtPro adaptively merges motion proposals during articulated object reconstruction, sidestepping local minima and significantly boosting accuracy.
Reconstructing articulated objects into high-fidelity digital twins is crucial for applications such as robotic manipulation and interactive simulation. Recent self-supervised methods using differentiable rendering frameworks like 3D Gaussian Splatting remain highly sensitive to the initial part segmentation. Their reliance on heuristic clustering or pre-trained models often causes optimization to converge to local minima, especially for complex multi-part objects. To address these limitations, we propose ArtPro, a novel self-supervised framework that introduces adaptive integration of mobility proposals. Our approach begins with an over-segmentation initialization guided by geometry features and motion priors, generating part proposals with plausible motion hypotheses. During optimization, we dynamically merge these proposals by analyzing motion consistency among spatial neighbors, while a collision-aware motion pruning mechanism prevents erroneous kinematic estimation. Extensive experiments on both synthetic and real-world objects demonstrate that ArtPro achieves robust reconstruction of complex multi-part objects, significantly outperforming existing methods in accuracy and stability.