Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel training strategy for confidence estimation in omnidirectional stereo systems, specifically addressing the challenges of ambiguous matches in wide-baseline configurations. By leveraging expectation values from matching responses produced by a 3D encoder-decoder block, the authors effectively penalize ambiguous responses without the need for auxiliary heads or multi-pass inference, leading to more efficient predictions. Additionally, the method incorporates swept feature volume resampling to enhance depth coherence and surface normal prediction, yielding significant improvements in both confidence estimation and practical deployment for autonomous mobility applications.
Ambiguous matches in wide-baseline stereo setups can be effectively managed without complex architectures, leading to enhanced confidence and surface normal predictions.
In this paper, we propose a training strategy for confidence estimation in omnidirectional stereo, targeting the ambiguous matches that frequently occur in wide-baseline setups. Reinterpreting the matching responses produced by the 3D encoder decoder block, we show that their expectation values provide intrinsic confidence signals. Building on this, our method directly penalizes ambiguous responses without auxiliary heads, multi-pass inference, or additional modules, resulting in more efficient and generalized predictions. Beyond confidence, we introduce swept feature volume resampling, where response features produced by 3D CNNs are resampled using regressed positive matching indices and then processed by 2D CNNs to predict meta-information such as surface normals. This joint learning introduces auxiliary geometric regularization and improves depth coherence by leveraging additional contextual cues during response aggregation stage. Experimental results demonstrate that our approach enhances both confidence estimation and surface normal prediction while maintaining deployment practicality for autonomous mobility applications.