Search papers, labs, and topics across Lattice.
This paper investigates the use of affine transformations in stereo vision for tasks like surface normal estimation and 3D reconstruction. It analyzes the impact of transformation accuracy on reconstruction quality and introduces new techniques for estimating local affine transformations from corresponding image directions, leveraging the fundamental matrix. Through synthetic and real-world experiments using a custom calibration object, the study demonstrates surface normal estimation accuracy within a few degrees for realistic scenarios, while also exploring limitations related to stereo poses and plane orientations.
Affine transformations in stereo vision can achieve surface normal estimation accuracy within a few degrees, but performance is highly sensitive to stereo pose and plane orientation.
Affine transformations have been recently used for stereo vision. They can be exploited in various computer vision application, e.g., when estimating surface normals, homographies, fundamental and essential matrices. Even full 3D reconstruction can be obtained by using affine correspondences. First, this paper overviews the fundamental statements for affine transformations and epipolar geometry. Then it is investigated how the transformation accuracy influences the quality of the 3D reconstruction. Besides, we propose novel techniques for estimating the local affine transformation from corresponding image directions; moreover, the fundamental matrix, related to the processed image pair, can also be exploited. Both synthetic and real quantitative evaluations are implemented based on the accuracy of the reconstructed surface normals. For the latter one, a special object, containing three perpendicular planes with chessboard patterns, is constructed. The quantitative evaluations are based on the accuracy of the reconstructed surface normals and it is concluded that the estimation accuracy is around a few degrees for realistic test cases. Special stereo poses and plane orientations are also evaluated in detail.