Search papers, labs, and topics across Lattice.
This paper introduces BendTwin, a novel bending-aware differentiable spring-mass model that enhances the reconstruction of deformable objects from video data by incorporating bending stiffness and damping constraints. By penalizing deviations from rest angles and regularizing higher-order deformation, BendTwin significantly improves mechanical stability compared to traditional axial-only spring models. Experimental results demonstrate that BendTwin outperforms the existing PhysTwin baseline, maintaining stability across various downsampling ratios and effectively constructing mechanically faithful digital twins from sparse-view RGB-D videos.
Bending-aware constraints in BendTwin lead to superior mechanical stability and fidelity in reconstructing deformable objects from video, outperforming traditional models.
Reconstructing objects with mechanical properties from video observations enables physically consistent dynamic prediction, benefiting robotics planning and interaction. Existing spring--mass based physical driven reconstruction approaches offer efficient and differentiable physical reconstruction, but they typically rely on axial springs alone. Such formulations oversimplify the underlying structural mechanics and can become mechanically under-constrained when the physical graph is coarsened, limiting their ability to preserve stable local deformation. We present BendTwin, a bending-aware differentiable spring--mass framework for video-based reconstruction and future prediction of deformable objects. BendTwin introduces bending stiffness and damping over local surface triplets, penalizing deviations from rest angles and regularizing higher-order deformation. These bending constraints improve mechanical stability while preserving the simplicity of spring--mass system. Experiments show that BendTwin consistently outperforms the axial-only PhysTwin baseline. Ablation studies further demonstrate that the bending constraints maintain system stability across different downsampling ratios and consistently improve upon the original PhysTwin formulation. Overall, BendTwin provides an effective approach for constructing mechanically faithful digital twins from sparse-view RGB-D videos.
