Search papers, labs, and topics across Lattice.
This paper introduces KinemaForge, a novel pipeline that simultaneously reconstructs part-level shapes and estimates kinematic parameters from RGB-D sequences while ensuring energy conservation in the resulting URDF models. By employing a kinematic constraint graph, a differentiable screw-axis solver, and an energy residual loss, the approach effectively addresses the decoupling of geometric reconstruction and kinematic estimation, which has plagued previous methods. The results demonstrate significant improvements, reducing joint-axis errors by up to 46.6% and decreasing simulation drift by 64%, thereby enhancing the fidelity of digital twins in physics simulations.
Energy-consistent URDF models reduce simulation drift by 64%, dramatically improving the realism of articulated object interactions in digital twins.
Reconstructing simulation-ready digital twins of articulated objects from sensor observations remains constrained by two persistent gaps: (i) part-level geometric reconstruction is decoupled from kinematic-parameter estimation, and (ii) the recovered models often violate basic dynamic invariants such as energy conservation, leading to drift when the URDF is replayed in physics simulators. We present KinemaForge, a constraint-driven pipeline that jointly infers part-level shape, joint topology, and joint parameters from short RGB-D sequences and validates the result against an energy-consistent verifier built on differentiable rigid-body dynamics. The pipeline introduces three components: a kinematic constraint graph that encodes joint-part incidences as soft edges; a differentiable screw-axis solver that backpropagates from rendered observations through Featherstone's articulated-body algorithm to joint parameters; and an energy residual loss that penalises non-physical free responses of the reconstructed model. Across five PartNet-Mobility categories and an internal RGB-D benchmark, KinemaForge reduces the average joint-axis error from 4.52 degrees to 2.83 degrees (-37.4%) over the strongest geometric baseline (PARIS) and from 5.30 degrees to 2.83 degrees (-46.6%) over the interaction-based Ditto baseline, lowers long-horizon simulation drift by 64% (vs. PARIS) over 50 s rollouts, and yields URDFs whose closed-loop manipulation success rate improves by 14.6 percentage points over Ditto in our preliminary evaluation. Code and reconstruction data will be released upon acceptance.
