Search papers, labs, and topics across Lattice.
The paper introduces ARport, an augmented reality system for markerless image-guided port placement in robotic surgery that aims to improve the accuracy and efficiency of trocar placement by bridging the gap between preoperative planning and intraoperative execution. ARport utilizes an optical see-through head-mounted display (OST-HMD) to reconstruct the operative scene, extract the patient's body surface using a foundation model, and perform surface-based markerless registration to align preoperative anatomical models. Experiments on a human phantom demonstrate the system's ability to accurately overlay pre-planned trocar sites onto the physical phantom, showing potential for seamless integration into clinical workflows.
Surgeons can now visualize pre-planned trocar placements directly on a patient's body using only an AR headset, eliminating the need for external sensors or markers.
Purpose: Precise port placement is a critical step in robot-assisted surgery, where port configuration influences both visual access to the operative field and instrument maneuverability. To bridge the gap between preoperative planning and intraoperative execution, we present ARport, an augmented reality (AR) system that automatically maps pre-planned trocar layouts onto the patient's body surface, providing intuitive spatial guidance during surgical preparation. Methods: ARport, implemented on an optical see-through head-mounted display (OST-HMD), operates without any external sensors or markers, simplifying setup and enhancing workflow integration. It reconstructs the operative scene from RGB, depth, and pose data captured by the OST-HMD, extracts the patient's body surface using a foundation model, and performs surface-based markerless registration to align preoperative anatomical models to the extracted patient's body surface, enabling in-situ visualization of planned trocar layouts. A demonstration video illustrating the overall workflow is available online. Results: In full-scale human-phantom experiments, ARport accurately overlaid pre-planned trocar sites onto the physical phantom, achieving consistent spatial correspondence between virtual plans and real anatomy. Conclusion: ARport provides a fully marker-free and hardware-minimal solution for visualizing preoperative trocar plans directly on the patient's body surface. The system facilitates efficient intraoperative setup and demonstrates potential for seamless integration into routine clinical workflows.
