Search papers, labs, and topics across Lattice.
This paper introduces a dual-arm surgical assistive robot designed for collision-free instrument delivery in dynamic surgical environments. The system uses a vision-language model to generate grasping and delivery trajectories from surgeon instructions in a zero-shot manner, eliminating the need for predefined paths. A unified quadratic programming framework incorporating real-time obstacle distance perception ensures reactive obstacle avoidance and self-collision prevention, resulting in an 83.33% success rate in instrument delivery during experiments.
A surgical robot now delivers instruments with 83% accuracy using vision-language models to interpret surgeon requests and avoid collisions in real-time.
During surgery, scrub nurses are required to frequently deliver surgical instruments to surgeons, which can lead to physical fatigue and decreased focus. Robotic scrub nurses provide a promising solution that can replace repetitive tasks and enhance efficiency. Existing research on robotic scrub nurses relies on predefined paths for instrument delivery, which limits their generalizability and poses safety risks in dynamic environments. To address these challenges, we present a collision-free dual-arm surgical assistive robot capable of performing instrument delivery. A vision-language model is utilized to automatically generate the robot's grasping and delivery trajectories in a zero-shot manner based on surgeons' instructions. A real-time obstacle minimum distance perception method is proposed and integrated into a unified quadratic programming framework. This framework ensures reactive obstacle avoidance and self-collision prevention during the dual-arm robot's autonomous movement in dynamic environments. Extensive experimental validations demonstrate that the proposed robotic system achieves an 83.33% success rate in surgical instrument delivery while maintaining smooth, collision-free movement throughout all trials. The project page and source code are available at https://give-me-scissors.github.io/.
