Search papers, labs, and topics across Lattice.
The D4D Dataset is introduced, offering paired endoscopic video and structured-light geometry of deforming abdominal soft tissue from porcine cadaver sessions, designed for evaluating 3D reconstruction algorithms in realistic surgical settings. Data acquisition involved a da Vinci Xi stereo endoscope and a Zivid structured-light camera, registered via optical tracking and iterative alignment. The dataset, comprising over 300,000 frames and 369 point clouds across 98 recordings, includes rectified stereo images, instrument masks, stereo depth, structured-light point clouds, and camera poses, enabling quantitative geometric evaluation and photometric view-synthesis.
A new dataset of paired endoscopic video and structured-light geometry offers a much-needed benchmark for 4D reconstruction of deforming soft tissue in surgical settings.
The D4D Dataset provides paired endoscopic video and high-quality structured-light geometry for evaluating 3D reconstruction of deforming abdominal soft tissue in realistic surgical conditions. Data were acquired from six porcine cadaver sessions using a da Vinci Xi stereo endoscope and a Zivid structured-light camera, registered via optical tracking and manually curated iterative alignment methods. Three sequence types - whole deformations, incremental deformations, and moved-camera clips - probe algorithm robustness to non-rigid motion, deformation magnitude, and out-of-view updates. Each clip provides rectified stereo images, per-frame instrument masks, stereo depth, start/end structured-light point clouds, curated camera poses and camera intrinsics. In postprocessing, ICP and semi-automatic registration techniques are used to register data, and instrument masks are created. The dataset enables quantitative geometric evaluation in both visible and occluded regions, alongside photometric view-synthesis baselines. Comprising over 300,000 frames and 369 point clouds across 98 curated recordings, this resource can serve as a comprehensive benchmark for developing and evaluating non-rigid SLAM, 4D reconstruction, and depth estimation methods.