Search papers, labs, and topics across Lattice.
This paper introduces DiffSAC, a novel framework that leverages a diffusion model to enhance the efficiency of consensus-based robust estimation in computer vision. By learning the distribution of effective minimum sets and refining confidence for data points, DiffSAC significantly reduces the need to evaluate numerous poor hypotheses, achieving state-of-the-art performance with only dozens of evaluations instead of tens of thousands. Extensive experiments across five classic tasks validate that DiffSAC not only improves efficiency but also enables real-time operation, making it a versatile plug-and-play module for existing methods.
Achieving state-of-the-art robust estimation efficiency, DiffSAC slashes hypothesis evaluations from over 10,000 to just dozens.
Robust estimation is a core computer vision task frequently tackled using sample consensus. However, traditional methods suffer from inefficient sampling as they struggle to identify effective minimum sets before hypothesis evaluation. To address these challenges, we propose a novel Diffusion-guided Sampling for Consensus-based Robust Estimation (DiffSAC) framework. DiffSAC introduces a diffusion model to learn the distribution of effective minimum sets. It refines the confidence for each data point, indicating whether it belongs to a good minimum set, rather than ranking the data points as in previous work. This significantly reduces the need to process numerous bad sets. To constrain the refinement direction, geometric features are incorporated as conditions within our diffusion model. Consequently, DiffSAC outputs a small number of high-quality minimum sets, enabling identification of the best hypothesis via consensus evaluation. Notably, compared to previous works requiring evaluating over ten thousand hypotheses, DiffSAC achieves state-of-the-art performance with only dozens, significantly boosting efficiency. Extensive experiments across five classic computer vision tasks demonstrate the superiority of DiffSAC. The diffusion model's sampling accelerators enable real-time operation, and DiffSAC can be used as a plug-and-play module to improve existing sample consensus methods.
