Search papers, labs, and topics across Lattice.
This study introduces a robotic system capable of autonomous clip positioning in laparoscopic cholecystectomy, utilizing a colorless point cloud segmented from a single camera. The segmentation model, trained on a limited dataset of 60 hand-labeled point clouds, is enhanced through pre-training on 128,000 synthetic examples and novel data augmentation techniques, achieving target localization precision of 0.75 mm with a 95% success rate. The system's ability to visualize end-effector motion and ensure interpretability makes it a significant advancement for high-risk robotic surgical applications.
Achieving 100% success in autonomous clip positioning, this robotic system redefines precision in laparoscopic surgery with minimal data requirements.
High-risk applications in robotics, such as robot-assisted surgery, present unique challenges. These systems must be both highly precise and interpretable in order to be deployed in environments with very low tolerance for error or unsafe exploration. We present the first robotic system to demonstrate autonomous clip positioning on a physical phantom in laparoscopic surgery, one of the most common interventions in general surgery. After segmentation of a colorless point cloud from a single camera, target positions for the clips are extracted using spline interpolation, and can then be adjusted by the human operator. The segmentation model is trained on only 60 hand-labeled real point clouds, reflecting data scarcity in the surgical domain. We overcome this with a combination of pre-training on 128,000 synthetic point clouds and two novel data augmentation techniques. The motion of the end-effector to each target is visualized for the operator, satisfying the unique motion constraints of minimally-invasive surgery while ensuring that the robot's actions are verifiable and interpretable. In real robot experiments, our system localizes targets with the required precision of 0.75 mm at a 95% success rate and executes autonomous clip positioning with a 100% success rate. We provide insights that are applicable to many other surgical and non-surgical tasks that require identifying and navigating to a precise target.
