Search papers, labs, and topics across Lattice.
This paper introduces a novel 3D Field of Junctions (3D FoJ) representation for volumetric data, extending the 2D Field of Junctions concept to 3D by optimizing junctions of 3D wedges to explain volume patches while enforcing consistency. The 3D FoJ acts as a training-free structural prior that enhances sharp edges and corners in 3D volumes, even at low signal-to-noise ratios. Experiments across low-dose CT, cryo-ET, and LiDAR point cloud denoising demonstrate that 3D FoJ outperforms existing methods in challenging low-SNR volumetric imaging tasks.
Ditch the training data and still get state-of-the-art 3D volume denoising, even with extremely noisy data, using a clever geometric prior.
Volume denoising is a foundational problem in computational imaging, as many 3D imaging inverse problems face high levels of measurement noise. Inspired by the strong 2D image denoising properties of Field of Junctions (ICCV 2021), we propose a novel, fully volumetric 3D Field of Junctions (3D FoJ) representation that optimizes a junction of 3D wedges that best explain each 3D patch of a full volume, while encouraging consistency between overlapping patches. In addition to direct volume denoising, we leverage our 3D FoJ representation as a structural prior that: (i) requires no training data, and thus precludes the risk of hallucination, (ii) preserves and enhances sharp edge and corner structures in 3D, even under low signal to noise ratio (SNR), and (iii) can be used as a drop-in denoising representation via projected or proximal gradient descent for any volumetric inverse problem with low SNR. We demonstrate successful volume reconstruction and denoising with 3D FoJ across three diverse 3D imaging tasks with low-SNR measurements: low-dose X-ray computed tomography (CT), cryogenic electron tomography (cryo-ET), and denoising point clouds such as those from lidar in adverse weather. Across these challenging low-SNR volumetric imaging problems, 3D FoJ outperforms a mixture of classical and neural methods.
