Search papers, labs, and topics across Lattice.
The paper introduces TWISTED-RL, a hierarchical reinforcement learning framework for robotic knot-tying that builds upon the TWISTED architecture. It replaces TWISTED's supervised learning-based inverse model with a multi-step RL policy conditioned on abstract topological actions, enabling more precise control over topological state transitions. Experiments show TWISTED-RL achieves state-of-the-art performance in tying complex knots like Figure-8 and Overhand without human demonstrations, exhibiting improved success rates and reduced planning time.
Robots can now tie more complex knots without human demonstrations, thanks to a hierarchical RL approach that reasons about abstract topological actions.
Robotic knot-tying represents a fundamental challenge in robotics due to the complex interactions between deformable objects and strict topological constraints. We present TWISTED-RL, a framework that improves upon the previous state-of-the-art in demonstration-free knot-tying (TWISTED), which smartly decomposed a single knot-tying problem into manageable subproblems, each addressed by a specialized agent. Our approach replaces TWISTED's single-step inverse model that was learned via supervised learning with a multi-step Reinforcement Learning policy conditioned on abstract topological actions rather than goal states. This change allows more delicate topological state transitions while avoiding costly and ineffective data collection protocols, thus enabling better generalization across diverse knot configurations. Experimental results demonstrate that TWISTED-RL manages to solve previously unattainable knots of higher complexity, including commonly used knots such as the Figure-8 and the Overhand. Furthermore, the increase in success rates and drop in planning time establishes TWISTED-RL as the new state-of-the-art in robotic knot-tying without human demonstrations.
