Search papers, labs, and topics across Lattice.
SUFLECA introduces a weakly-supervised framework for zero-shot CAD-to-image alignment that leverages geometry-grounded feature learning through Normalized Object Coordinates (NOCs) supervision on a large dataset of 674K images. This approach enhances the robustness of correspondences against occlusion and domain shifts, achieving reliable one-to-one CAD-to-image matching without the need for iterative pose refinement. The framework demonstrates significant improvements in accuracy on the ScanNet25k benchmark, outperforming existing zero-shot methods and even surpassing fully supervised approaches with a reduced computational burden.
SUFLECA achieves a remarkable 33.4% category accuracy and 42.3% instance accuracy in CAD-to-image alignment, outpacing traditional methods while cutting down computational costs.
CAD-to-image alignment aims to estimate an object's 9D pose (rotation, translation, and anisotropic scale) from a single RGB image, enabling applications in robotics and augmented reality. Recent zero-shot methods use visual foundation models to match image regions to CAD models, yet typically their correspondences are appearance-driven and degrade under occlusion or sim-to-real domain shift. To address these limitations, we introduce SUFLECA (Scaling Up Feature LEarning for CAD Alignment), a weakly-supervised framework for zero-shot CAD alignment with two key contributions. First, SUFLECA scales up geometry-grounded feature learning from pretrained visual representations through Normalized Object Coordinates (NOCs) supervision on 674K images spanning 12 real and synthetic datasets, learning compact geometry-aware features that generalize across domains. Second, we propose a geometrically consistent matching algorithm that establishes reliable one-to-one CAD-to-image correspondences. Together, these contributions enable accurate, sub-second alignment per object instance without iterative pose refinement. On ScanNet25k, SUFLECA achieves 33.4%/42.3% category/instance accuracy, outperforming, with a smaller computational footprint, the strongest zero-shot baseline by 10.3/12.2 percentage points and, for the first time on this benchmark, even surpassing fully supervised methods. Code is available at: https://github.com/snt-arg/SUFLECA
