Search papers, labs, and topics across Lattice.
This study introduces DiffeoAfford, a novel action-grounded tissue affordance framework that generates visual attention supervision for laparoscopic surgery by retrospectively analyzing completed procedures. By leveraging diffeomorphism-constrained tissue tracking and instrument trajectory analysis, the framework produces affordance hotspot labels without the need for manual annotation. The resulting AffordView system effectively anticipates relevant surgical regions, aligning with expert annotations and significantly lowering cognitive workload for surgeons during real-world operations.
Surgeons can now rely on a system that reduces cognitive workload by predicting relevant surgical regions in real-time, transforming laparoscopic visualization.
Computational attention models could help surgeons manage the visual demands of laparoscopy, but they require dense spatial labels that are difficult to obtain because surgical intent is highly specialized and tacit. Here, we introduce DiffeoAfford, an action-grounded tissue affordance framework that retrospectively derives visual attention supervision from completed surgical procedures. By combining diffeomorphism-constrained tissue tracking with instrument trajectory analysis, DiffeoAfford generates affordance hotspot labels without manual per-frame annotation. A real-time prediction model trained on these labels anticipates relevant surgical regions and enables AffordView, an assistive auto-framing system for laparoscopic visualization. The proposed framework aligns with expert annotations and intraoperative surgeon gaze, and reduces surgeon cognitive workload during real-world evaluations using subjective, physiological, and behavioral measures.
