Search papers, labs, and topics across Lattice.
This paper introduces an unsupervised learning framework that addresses the challenge of pixel-level semantic left-right prediction in in-the-wild images, which is complicated by factors like occlusion and object pose variation. By integrating a medium-scale 3D shape dataset with diverse image data, the method successfully infers pixel-wise semantic predictions even for unseen 3D object categories. The results demonstrate a significant performance improvement over existing state-of-the-art techniques in dense pixel-wise predictions for both rendered and real-world images.
Unsupervised learning can achieve high-quality pixel-level semantic left-right predictions in images, even for entirely unseen object categories.
While various works address reflective symmetry understanding in 3D data and images, pixel-level semantic left-right prediction of in-the-wild images remains challenging, due to certain difficulties including the lack of 3D information, occlusion, object pose variation, partiality, etc. In this work, we propose an unsupervised learning framework to tackle this challenge. Leveraging recent advances in vertex-wise semantic left-right understanding of 3D data, our unsupervised learning method jointly utilises 3D shape and image datasets to infer pixel-wise semantic left-right predictions in single-view images. In particular, we show that a medium-scale 3D shape dataset comprising mainly of human- and quadruped animal-like shapes, combined with diverse in-the-wild image data, are sufficient to achieve high-quality semantic left-right prediction in images, even for entirely unseen 3D object categories, such as cars or trains. Overall, our approach achieves superior performance in dense pixel-wise semantic left-right predictions on both rendered and in-the-wild image datasets when compared to existing state-of-the-art methods.
