Search papers, labs, and topics across Lattice.
ArtiTwinSplat introduces a novel framework for constructing articulated, photo-realistic digital twins from RGB-D videos without the need for CAD models or manual annotations. The method leverages 3D Gaussian Splatting to maintain both geometric fidelity and photometric realism, while an unsupervised articulation discovery pipeline extracts part structure and joint kinematics from motion data. This enables the creation of stable, interactive digital twins that can be directly utilized in robotic planning and learning, significantly lowering the barriers for integrating articulated object manipulation in real-world applications.
Real-world robots can now leverage photo-realistic digital twins constructed directly from RGB-D videos, eliminating the need for manual modeling.
Deploying robots in unstructured real-world environments needs accurate, interactive models of the objects. Constructing these models at scale remains a critical bottleneck for robotic system integration. We present ArtiTwinSplat, a framework that automatically constructs articulated, photo-realistic digital twins of objects directly from RGB-D videos, requiring no CAD models, simulation assets, or manual annotations. Our method is built on 3D Gaussian Splatting that preserve geometric fidelity and photometric realism, coupled with an unsupervised articulation discovery pipeline that recovers part structure and joint kinematics from observed motion alone. With tracking and optimization stages our method provides stable, queryable digital twins that support real-time rendering, viewpoint control, and interactive manipulation. Unlike prior methods confined to simulation, ArtiTwinSplat operates directly on real-world observations and produces twins that are immediately usable by downstream robot planning and learning systems. This method offers a practical, scalable pathway toward digital twin construction, lowering the integration barrier for articulated object manipulation in embodied AI and human-robot collaboration contexts.
