Search papers, labs, and topics across Lattice.
This paper introduces a novel simulation framework that integrates continuum mechanics into the MuJoCo physics engine, enabling effective contact-rich manipulation for tendon-driven continuum robots (TDCRs). By validating the simulator against both theoretical models and real hardware, the authors demonstrate its capability to handle complex interactions and dynamics inherent to soft robotics. The resulting state-based imitation learning policies were successfully deployed in real-world tasks, marking a significant advancement in sim-to-real transfer for soft robots.
The first successful sim-to-real transfer for contact-rich manipulation with tendon-driven continuum robots could redefine soft robotics applications.
Learning contact-rich, whole-body manipulation for soft continuum robots is held back by the lack of simulation infrastructure that has accelerated rigid-robot manipulation. Existing soft robot simulators are physically grounded but lack the contact handling, actuation support, or learning integration needed for contact-rich manipulation; rigid-body approximations offer these capabilities but sacrifice physical grounding. We bridge this gap for tendon-driven continuum robots (TDCRs) by deriving a continuum-mechanics-informed discretization that places the soft robot natively inside MuJoCo, unifying tendon forces, body contact, and dynamics in a single physics pipeline. We validate the simulator against a Cosserat rod reference (static and dynamic) and real TDCR hardware. We then train state-based imitation learning policies via teleoperation in simulation and deploy them zero-shot to a physical 3-segment TDCR on a 7-DoF Franka arm across two contact-rich manipulation tasks. To our knowledge, this is the first demonstration of sim-to-real transfer for contact-rich manipulation with continuum robots.