Search papers, labs, and topics across Lattice.
This paper introduces a monocular endoscopic image-based perception platform for continuum robots in endoluminal surgery, aiming to estimate the pose of flexible instruments and their distance to tissue. They developed 2D and 3D learning-based perception algorithms and a physically-realistic simulator to generate training data and model instrument dynamics. Experimental results on a continuum robot prototype demonstrate a 70% reduction in manipulation time for trajectory-following tasks, indicating improved instrument control.
Monocular vision, combined with a physically-realistic simulator, enables a 70% speedup in robotic endoluminal surgery tasks.
Endoluminal surgery offers a minimally invasive option for early-stage gastrointestinal and urinary tract cancers but is limited by surgical tools and a steep learning curve. Robotic systems, particularly continuum robots, provide flexible instruments that enable precise tissue resection, potentially improving outcomes. This paper presents a visual perception platform for a continuum robotic system in endoluminal surgery. Our goal is to utilize monocular endoscopic image-based perception algorithms to identify position and orientation of flexible instruments and measure their distances from tissues. We introduce 2D and 3D learning-based perception algorithms and develop a physically-realistic simulator that models flexible instruments dynamics. This simulator generates realistic endoluminal scenes, enabling control of flexible robots and substantial data collection. Using a continuum robot prototype, we conducted module and system-level evaluations. Results show that our algorithms improve control of flexible instruments, reducing manipulation time by over 70% for trajectory-following tasks and enhancing understanding of surgical scenarios, leading to robust endoluminal surgeries.
