Search papers, labs, and topics across Lattice.
This paper addresses the problem of real-time 3D reconstruction of deformable endoscopic tissues from monocular endoscopic videos by improving 3D Gaussian Splatting. They introduce a surface-aware reconstruction pipeline that leverages a Sign Distance Field-based mesh to constrain Gaussian Splatting, promoting consistent tissue surface reconstruction. The method further incorporates local rigidity and global non-rigidity constraints to guide Gaussian deformation, ensuring physically plausible deformations suitable for soft tissues.
Achieve real-time, smooth 3D reconstruction of deformable endoscopic tissue by guiding 3D Gaussian Splatting with multi-level geometry regularization, outperforming existing NeRF and Gaussian Splatting methods.
Reconstructing deformable endoscopic tissues is crucial for achieving robot-assisted surgery. However, 3D Gaussian Splatting-based approaches encounter challenges in achieving consistent tissue surface reconstruction, while existing NeRF-based methods lack real-time rendering capabilities. In pursuit of both smooth deformable surfaces and real-time rendering, we introduce a novel approach based on 3D Gaussian Splatting. Specifically, we introduce surface-aware reconstruction, initially employing a Sign Distance Field-based method to construct a mesh, subsequently utilizing this mesh to constrain the Gaussian Splatting reconstruction process. Furthermore, to ensure the generation of physically plausible deformations, we incorporate local rigidity and global non-rigidity restrictions to guide Gaussian deformation, tailored for the highly deformable nature of soft endoscopic tissue. Based on 3D Gaussian Splatting, our proposed method delivers a fast rendering process and smooth surface appearances. Quantitative and qualitative analysis against alternative methodologies shows that our approach achieves solid reconstruction quality in both textures and geometries.
