Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the GastroNVS dataset, the first real dataset specifically designed for novel view synthesis in gastroendoscopy, comprising gastroscopic images, camera poses, and a point cloud for enhanced inspection. The significance of this dataset lies in its potential to improve endoscopic imaging techniques and facilitate the development of digital twins for training and procedural enhancement. Evaluation of various 3D Gaussian splatting methods on this dataset reveals critical challenges and opportunities for advancing NVS applications in the medical field.
The GastroNVS dataset could revolutionize gastroendoscopic imaging by enabling advanced view synthesis techniques that enhance both training and procedural outcomes.
Novel view synthesis (NVS) is an active research topic in computer vision, owing to the success of neural radiance field (NeRF) and 3D Gaussian splatting (3DGS) methods. While NVS opens the door to potential applications in gastroendoscopy, such as extending the field of view of endoscopic images and enabling digital twins for 3D archiving and endoscopist manipulation training, the dataset is insufficient to evaluate NVS for gastroendoscopy. In this paper, we present the first real gastroscopy dataset for NVS, namely the GastroNVS dataset, which contains a set of gastroscopic images, camera poses, and a point cloud for real gastroendoscopy inspection. To assess the suitability of the GastroNVS dataset, we evaluate several 3DGS methods and discuss the challenges for future development. The dataset is available on request from our project page.