Search papers, labs, and topics across Lattice.
This paper introduces a hierarchical vision-only autonomy framework for bronchoscopic navigation, using a short-term reactive agent for motion control and a long-term strategic agent for decision support. A world-model critic resolves conflicts between the agents by predicting future visual states and selecting actions that best match the target view. The system demonstrated successful navigation in airway phantoms, ex vivo porcine lungs, and a live porcine model, achieving in vivo performance comparable to expert bronchoscopists.
Achieve expert-level bronchoscopic navigation without external sensors by having a world-model critic arbitrate between reactive and strategic AI agents.
Accurate intraoperative navigation is essential for robot-assisted endoluminal intervention, but remains difficult because of limited endoscopic field of view and dynamic artifacts. Existing navigation platforms often rely on external localization technologies, such as electromagnetic tracking or shape sensing, which increase hardware complexity and remain vulnerable to intraoperative anatomical mismatch. We present a vision-only autonomy framework that performs long-horizon bronchoscopic navigation using preoperative CT-derived virtual targets and live endoscopic video, without external tracking during navigation. The framework uses hierarchical long-short agents: a short-term reactive agent for continuous low-latency motion control, and a long-term strategic agent for decision support at anatomically ambiguous points. When their recommendations conflict, a world-model critic predicts future visual states for candidate actions and selects the action whose predicted state best matches the target view. We evaluated the system in a high-fidelity airway phantom, three ex vivo porcine lungs, and a live porcine model. The system reached all planned segmental targets in the phantom, maintained 80\% success to the eighth generation ex vivo, and achieved in vivo navigation performance comparable to the expert bronchoscopist. These results support the preclinical feasibility of sensor-free autonomous bronchoscopic navigation.
