Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to RGB-NIR low-light imaging that integrates 3D-aware neural modeling to enhance image quality without relying on clean RGB supervision. By optimizing a model to fuse noisy RGB observations with NIR cues in 3D space, the method effectively recovers clean RGB images across various noise levels. Extensive evaluations on both synthetic and real datasets confirm the model's robustness and superiority over existing techniques that depend on curated training data pairs.
Achieving high-quality low-light imaging without the need for clean RGB data could revolutionize how we approach image enhancement in challenging environments.
Robust low-light imaging remains challenging for the community. Recent studies have explored fusing Near-Infrared (NIR) with noisy RGB to achieve improved enhancement, yet most methods depend on carefully curated training data pairs, with limited robustness under different scenarios. This paper offers a new perspective for RGB-NIR low-light imaging by incorporating 3D-aware neural modeling. Without using clean RGB supervision, a powerful model can be optimized to implicitly fuse extremely noisy RGB observations with NIR cues in 3D space, effectively recovering clean RGB images. The proposed model obviates the requirement for clean RGB data collection, generalizes across different noise levels. Extensive evaluations on synthetic and real data demonstrate its superiority. Codes available: https://github.com/MyNiuuu/3DarkFusion
