Search papers, labs, and topics across Lattice.
This paper introduces DreamReg, a belief-driven world model designed to enhance real-time registration of 2D ultrasound slices with preoperative 3D volumes, addressing challenges such as partial observability and speckle noise. By maintaining a latent belief state that captures past observations and refining transformations through learned dynamics, DreamReg effectively simulates candidate probe motions during inference to achieve accurate rigid transformations. Experimental results on the CAMUS and u-RegPro datasets show that DreamReg outperforms existing methods in robustness and registration accuracy for surgical navigation.
DreamReg's innovative belief-driven approach allows for real-time ultrasound registration that adapts dynamically to surgeon feedback, significantly enhancing surgical navigation accuracy.
Ultrasound (US) is widely used for surgical navigation, yet real-time registration between intraoperative 2D slices and preoperative 3D volumes remains challenging due to partial observability, speckle noise, and the action-dependent US acquisition. Existing methods are one-shot or short-horizon, making it hard for them to gather evidence over time or capture how surgeons adjust probe motion based on on-screen feedback. We propose DreamReg, a belief-driven world-model framework that formulates 2D-3D registration as belief updating over rigid transformations. DreamReg maintains a latent belief state that summarizes past observations and poses information, and continuously refines the transformation through learned dynamics as new slices arrive. During training, DreamReg is exposed to probe-motion trajectories that mimic clinical scanning behavior and learns to update its belief by conditioning pose refinement on the current US observation. During inference, DreamReg refines registration via internal imagination: it rolls out the learned world model to simulate candidate probe motions and their predicted observations, and integrates these imagined outcomes to converge to an accurate rigid transformation. Experiments on CAMUS and u-RegPro datasets demonstrate improved robustness and competitive registration accuracy for real-time guidance compared with state-of-the-art methods.
