Search papers, labs, and topics across Lattice.
This paper introduces CrossScope, a role-asymmetric dual-stream model designed for predicting future dynamics in surgical videos from two independently moving scopes during endoscopic retrograde cholangiopancreatography (ERCP). By employing geometry-guided residual interactions, CrossScope selectively transfers cross-view evidence based on the spatial requirements of the prediction target, allowing each scope to maintain its unique representation while contributing relevant information. Experimental results show that CrossScope significantly outperforms existing baselines in visual fidelity, structural preservation, target localization, and motion consistency, highlighting the effectiveness of role-aware evidence routing in multi-observer settings.
Role-aware evidence routing in surgical video prediction leads to superior performance, demonstrating that asymmetric information exchange can enhance multi-observer models.
Visual world models typically learn future dynamics from a single observation stream, limiting their ability to model cooperative systems with multiple independently moving observers. We investigate this challenge in Mother--Child endoscopic retrograde cholangiopancreatography (ERCP), where two flexible scopes provide complementary yet role-dependent views without a calibrated stereo relationship. Unlike conventional multi-view fusion that assumes symmetric information exchange, we formulate \textbf{role-asymmetric dual-scope future prediction}, where cross-view evidence is selectively transferred according to the prediction target and its underlying spatial requirements. We propose \textbf{CrossScope}, a dual-stream surgical world model that preserves view-specific experts while enabling target-specific evidence routing through geometry-guided residual interactions. CrossScope learns two complementary communication directions: geometric motion cues from the Mother view guide Child-view future dynamics, while pose-aligned Child appearance supports Mother-view prediction only when valid spatial correspondence is established. This design allows each scope to contribute task-relevant evidence without compromising its view-specific representation. To evaluate this problem, we establish a paired dual-scope benchmark comprising synchronized phantom and real-world ERCP episodes, with evaluations assessing visual fidelity, structural preservation, target localization, and motion consistency. Experiments demonstrate that CrossScope consistently outperforms strong surgical video generation baselines, validating the importance of role-aware evidence routing for multi-observer visual world modeling.
