Search papers, labs, and topics across Lattice.
This paper introduces RigPI, a framework for accurately identifying dynamic parameters of rigid bodies during robot-object interactions by integrating vision-based semantic priors, force-torque measurements, and motion observations within a differentiable simulation pipeline. By leveraging a vision-language model for informed initialization and employing a two-stage optimization strategy, RigPI effectively mitigates issues related to sensing noise and modeling errors, leading to stable and accurate parameter estimates. Extensive real-world experiments demonstrate RigPI's capability to reproduce manipulation trajectories with predictive validity, underscoring its potential for enhancing robotic manipulation and digital twin construction.
RigPI achieves unprecedented stability and accuracy in dynamic parameter identification, even in the presence of noise and modeling errors.
Accurate physical parameter identification of manipulated objects is fundamental to advanced robotic manipulation and the construction of faithful digital twins. However, acquiring physically consistent inertial and frictional properties from real-world interactions remains challenging due to sensing noise, modeling errors, and limited prior knowledge. This paper presents \textbf{RigPI}, a systematic framework for identifying dynamic parameters of both unconstrained rigid bodies and multi-link rigid bodies during robot-object interaction. RigPI integrates vision-based semantic priors, force-torque measurements, and motion observations within a differentiable simulation pipeline. A vision-language model (VLM) provides informed initialization and a constrained search space, while gradient information from a differentiable physics simulator enables efficient and stable parameter refinement. The proposed two-stage optimization strategy alleviates sensitivity to noise and avoids physically implausible solutions. Extensive real-world experiments on objects with revolute and prismatic joints demonstrate that RigPI achieves accurate and stable parameter estimates, and successfully reproduces manipulation trajectories on a real robot with parameter-aware predictive validity. These results highlight the effectiveness and robustness of RigPI for real-world robotic system identification tasks.
