Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a comprehensive methodology for re-enacting surgical procedures in a reconstructed operating room (OR) to generate realistic datasets that capture the actions of all OR personnel. By addressing the challenges of acquiring data in real ORs—such as ethical constraints and sterility regulations—the authors facilitate the creation of repeatable and annotatable workflow datasets essential for training activity recognition models and formalizing surgical processes. The methodology, developed specifically for robot-assisted ophthalmic surgery, combines expert consultation, structured workflow formalization, and iterative recording, providing a framework that can be adapted for various surgical domains.
Realistic surgical workflow datasets can now be generated without the ethical and logistical hurdles of real operating rooms, revolutionizing training for activity recognition models.
The introduction of new technologies, such as surgical robots, is driving the vision of a connected, smart operating room (OR). However, realizing this vision requires a deep understanding of surgical workflows, which relies on realistic datasets capturing the actions of all OR personnel from both full room and surgical field perspectives. Acquiring such data in real ORs is prohibitively challenging due to factors such as ethics committee approvals, limited space for camera installation, and sterility regulations preventing the use of tracking markers. We present a step-by-step methodology for re-enacting complete surgical procedures in a reconstructed OR. This approach enables the creation of repeatable and annotatable workflow datasets for training activity recognition models, generating scene graphs, and formalizing surgical process models. Developed for robot-assisted ophthalmic surgery, our methodology combines expert consultation, structured workflow formalization, OR reconstruction, role-based training, real OR observation, and iterative recording with post-take debriefing. We provide concrete recommendations to allow other research groups to seamlessly adopt this methodology for their own surgical domains.