Search papers, labs, and topics across Lattice.
The paper introduces EndoDDC, a diffusion model-based approach for depth completion in endoscopic surgical scenes, designed to address challenges like weak textures and variable lighting that degrade performance in self-supervised depth estimation. EndoDDC leverages sparse depth information, depth gradient features, and a diffusion model to refine depth maps, improving accuracy and robustness in challenging endoscopic environments. Experiments on endoscopic datasets demonstrate that EndoDDC outperforms existing state-of-the-art depth completion methods.
Diffusion models can fill the depth-sensing void in endoscopies, turning unreliable sparse data into robust 3D reconstructions.
Accurate depth estimation plays a critical role in the navigation of endoscopic surgical robots, forming the foundation for 3D reconstruction and safe instrument guidance. Fine-tuning pretrained models heavily relies on endoscopic surgical datasets with precise depth annotations. While existing self-supervised depth estimation techniques eliminate the need for accurate depth annotations, their performance degrades in environments with weak textures and variable lighting, leading to sparse reconstruction with invalid depth estimation. Depth completion using sparse depth maps can mitigate these issues and improve accuracy. Despite the advances in depth completion techniques in general fields, their application in endoscopy remains limited. To overcome these limitations, we propose EndoDDC, an endoscopy depth completion method that integrates images, sparse depth information with depth gradient features, and optimizes depth maps through a diffusion model, addressing the issues of weak texture and light reflection in endoscopic environments. Extensive experiments on two publicly available endoscopy datasets show that our approach outperforms state-of-the-art models in both depth accuracy and robustness. This demonstrates the potential of our method to reduce visual errors in complex endoscopic environments. Our code will be released at https://github.com/yinheng-lin/EndoDDC.
