Search papers, labs, and topics across Lattice.
The paper introduces OSCAR, a novel occupancy-based shape completion method that reconstructs complete 3D vertebral anatomy from partial ultrasound observations without requiring anatomical labels during inference. OSCAR leverages a Neural Implicit Representation (NIR) to jointly model spatial occupancy and acoustic interactions, enabling implicit awareness of unseen regions by tracking acoustic signal transmission. Experiments on both in-silico and phantom US images demonstrate that OSCAR outperforms state-of-the-art shape completion methods by 80% in HD95 score, showcasing accurate reconstruction of occluded anatomy and robust generalization.
Achieve 80% better shape completion for ultrasound reconstruction by implicitly modeling acoustic interactions, eliminating the need for anatomical labels during inference.
Accurate 3D reconstruction of vertebral anatomy from ultrasound is important for guiding minimally invasive spine interventions, but it remains challenging due to acoustic shadowing and view-dependent signal variations. We propose an occupancy-based shape completion method that reconstructs complete 3D anatomical geometry from partial ultrasound observations. Crucially for intra-operative applications, our approach extracts the anatomical surface directly from the image, avoiding the need for anatomical labels during inference. This label-free completion relies on a coupled latent space representing both the image appearance and the underlying anatomical shape. By leveraging a Neural Implicit Representation (NIR) that jointly models both spatial occupancy and acoustic interactions, the method uses acoustic parameters to become implicitly aware of the unseen regions without explicit shadowing labels through tracking acoustic signal transmission. We show that this method outperforms state-of-the-art shape completion for B-mode ultrasound by 80% in HD95 score. We validate our approach both in-silico and on phantom US images with registered mesh models from CT labels, demonstrating accurate reconstruction of occluded anatomy and robust generalization across diverse imaging conditions. Code and data will be released on publication.