Search papers, labs, and topics across Lattice.
This paper introduces an iterative method for learning point correspondences between image sequences without prior knowledge of 3D geometry or surface shape. By optimizing the mapping of point sets based on Neyman's chi-square divergence, the proposed approach achieves fast convergence and high accuracy in real-time applications. Experimental results demonstrate that this method outperforms existing state-of-the-art techniques in both convergence speed and accuracy.
Achieving real-time, high-accuracy point correspondences without 3D scene knowledge could revolutionize image processing in dynamic environments.
We propose a novel method for iterative learning of point correspondences between image sequences. Points moving on surfaces in 3D space are projected into two images. Given a point in either view, the considered problem is to determine the corresponding location in the other view. The geometry and distortions of the projections are unknown, as is the shape of the surface. Given several pairs of point sets but no access to the 3D scene, correspondence mappings can be found by excessive global optimization or by the fundamental matrix if a perspective projective model is assumed. However, an iterative solution on sequences of point-set pairs with general imaging geometry is preferable. We derive such a method that optimizes the mapping based on Neyman's chi-square divergence between the densities representing the uncertainties of the estimated and the actual locations. The densities are represented as channel vectors computed with a basis function approach. The mapping between these vectors is updated with each new pair of images such that fast convergence and high accuracy are achieved. The resulting algorithm runs in real time and is superior to state-of-the-art methods in terms of convergence and accuracy in a number of experiments.