Search papers, labs, and topics across Lattice.
This paper introduces a novel framework for camera calibration in 3D reconstruction that utilizes scene ray predictions instead of traditional 2D planar methods, enhancing flexibility and accuracy in the reconstruction pipeline. By employing new metrics such as reconstruction and intersection error, the authors demonstrate that their approach significantly improves calibration accuracy, revealing that reprojection error can be misleading. The use of an icosahedron calibration target further enhances the calibration process, achieving approximately 40% lower mean intersection error on synthetic data while highlighting the need for precise fabrication in real-world applications.
Reprojection error can mislead 3D accuracy assessments, but a new ray-based calibration framework reveals a more reliable path to precision.
In 3D reconstruction, camera calibration is an essential element for achieving high fidelity and accuracy of the reconstructed geometry. While existing approaches rely upon 2D planar calibration, this work proposes a framework tailored for 3D reconstruction that is based on predicting scene rays, which adds flexibility to the reconstruction pipeline and enables the use of recent advances in camera models. Novel metrics, reconstruction and intersection error, derived from predicted scene rays are employed in combination with a bootstrapping procedure that statistically evaluates different calibration objects and calibration pipelines for both intrinsic and extrinsic camera parameters. The results show that the generalized distortion model more faithfully captures physical camera effects and yields an improvement in calibration accuracy. Reprojection error is shown to be a potentially misleading indicator of 3D accuracy, and the proposed ray-based metrics provide a more holistic assessment. An icosahedron calibration target is designed to enrich calibration information for 3D reconstruction together with a ring-feature-based detector. The icosahedral target yields approximately 40% lower mean intersection and more stable calibration across bootstrap trials on synthetic data, while real-data performance demands very tight fabrication tolerances.
