Search papers, labs, and topics across Lattice.
This paper introduces the Machine Vision Metrology Industrial Object Dataset (MVM-IOD), a novel benchmark for evaluating 3D reconstruction and camera pose estimation methods in industrial contexts. The dataset comprises systematically captured RGB images of nine industrial objects, accompanied by reference camera poses and 3D point clouds, enabling comprehensive assessments of state-of-the-art methods. Findings reveal that current feed-forward techniques struggle with out-of-distribution images generated in realistic industrial settings, suggesting that preprocessing is essential to improve their performance in practical applications.
Current state-of-the-art 3D reconstruction methods falter in industrial settings, revealing the critical need for preprocessing to align with training distributions.
3D object reconstruction, and camera pose estimation in industrial applications are challenging tasks, as errors are costly while the computation time is often limited. The complexity of typical industrial objects further complicates these tasks. Most of the existing datasets in this context do not depict realistic industrial scenarios. Therefore, we introduce the Machine Vision Metrology Industrial Object Dataset (MVM-IOD). Images of typical industrial objects are captured systematically, by moving a camera, mounted at the end effector of an industrial robot arm, on a hemisphere around the objects. MVM-IOD contains reference camera poses and reference 3D point clouds, the acquired RGB images of 9 objects and 2 background choices resulting in 18 scenes, which allows evaluation of all image based methods that compute a 3D reconstruction, camera poses, or novel views of a scene. Based on MVM-IOD, we extensively evaluate current SOTA 3D reconstruction and camera pose estimation methods, such as Structure from Motion, Multi-View Stereo, recent feed forward methods (Visual Geometry Grounded Transformer, 蟺3), and 2D Gaussian Splatting and report our findings as a baseline for future research. The experiments show that capture setups like ours generate out-of distribution images for feed forward methods, leading to suboptimal point clouds and camera poses. However, these out-of-distribution images can be shifted closer to the training distribution by applying simple preprocessing steps. Consequently, in certain industrial applications, feed forward methods should be used with caution.
