Search papers, labs, and topics across Lattice.
Dark3R adapts large-scale 3D foundation models to enable structure from motion (SfM) in extreme low-light conditions (SNRs below -4dB) where existing methods fail. This is achieved through teacher-student distillation, training on noisy-clean raw image pairs without requiring 3D supervision. The method achieves state-of-the-art SfM and novel view synthesis in low-light, validated on a new exposure-bracketed dataset of ~42,000 multi-view raw images with ground-truth 3D annotations.
See in the dark: Dark3R unlocks structure from motion at signal-to-noise ratios below -4dB, where existing methods completely break down.
We introduce Dark3R, a framework for structure from motion in the dark that operates directly on raw images with signal-to-noise ratios (SNRs) below $-4$ dB -- a regime where conventional feature- and learning-based methods break down. Our key insight is to adapt large-scale 3D foundation models to extreme low-light conditions through a teacher--student distillation process, enabling robust feature matching and camera pose estimation in low light. Dark3R requires no 3D supervision; it is trained solely on noisy--clean raw image pairs, which can be either captured directly or synthesized using a simple Poisson--Gaussian noise model applied to well-exposed raw images. To train and evaluate our approach, we introduce a new, exposure-bracketed dataset that includes $\sim$42,000 multi-view raw images with ground-truth 3D annotations, and we demonstrate that Dark3R achieves state-of-the-art structure from motion in the low-SNR regime. Further, we demonstrate state-of-the-art novel view synthesis in the dark using Dark3R's predicted poses and a coarse-to-fine radiance field optimization procedure.