Search papers, labs, and topics across Lattice.
This paper introduces CLEAR-NeRF, a NeRF-based pipeline designed for accurate 3D reconstruction of unbounded scenes with robustness to lighting and pose variations. It achieves this by incorporating automated local region localization, collinearity-enforcing ray sampling, depth-localized neighborhood point extraction, and geometry-relevant color aggregation. Experiments demonstrate CLEAR-NeRF's superior performance compared to baseline NeRF models and traditional SfM-MVS methods in challenging unbounded scenes.
Reconstructing accurate, photorealistic 3D models of complex real-world environments just got easier, thanks to a NeRF pipeline that intelligently focuses on regions of interest and handles lighting variations.
Many real-world 3D reconstruction applications demand photorealism and metric accuracy across unbounded, complex scenes with challenging lighting and imperfect captures that current Neural Radiance Field (NeRF) pipelines only partly satisfy. This study adapts NeRF-based 3D reconstruction to multi-region of interest unbounded scenes to improve robustness to lighting and pose variation while enforcing metric accuracy suitable for digital-twin applications. Our approach introduces (i) automated local region localization/detection and reconstruction to seamlessly prioritize areas of interest without proliferating submodules, (ii) collinearity-enforcing ray sampling to learn smooth planar and curved surfaces, (iii) depth-localized neighborhood point extraction to suppress surface artifacts, and (iv) geometry-relevant color aggregation to mitigate lighting- and pose-caused variations. Results indicate superior performance of the proposed pipeline over the baseline NeRF models and established Structure from Motion (SfM) - Multi-View Stereo (MVS) solutions.