Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors introduce prior-free relative 6D pose estimation—inferring the spatial relationships between multiple instances of an unknown object in a single image without CAD models, templates, or reference views—and propose a training-free framework called PROSE. The method extracts coarse inter-instance correspondences using multimodal foundation features, refines them through cycle consistency across instance tuples, and solves for globally consistent relative poses. Evaluated on PRENCH, a new multi-instance benchmark derived from the BOP challenge, PROSE consistently outperforms adapted state-of-the-art baselines without relying on task-specific supervision or learned parameters.
Relative 6D poses between identical unknown objects can now be resolved from a single image with zero CAD models, reference templates, or task-specific training.
Object 6D pose estimation formulations have progressively reduced reliance on object-specific priors, evolving from explicit 3D models to multi-view object captures to single reference images. We take this progression to its extreme by introducing prior-free relative 6D pose estimation, which lifts the assumption of knowing which object is to be posed within the scene. This novel setting aims to estimate the relative poses of multiple instances of an unknown object within the same image, without requiring CAD models, templates, or reference images. We solve this by formulating a novel method (PROSE) that finds coarse correspondences between object instances using multimodal foundation features, thus requiring no training. We refine these correspondences by imposing cycle consistency across tuples of instances, and leverage the resulting globally consistent correspondences to estimate the relative 6D pose between any pair of instances. To enable systematic evaluation, we design a novel benchmark (PRENCH) built from three multi-instance BOP datasets and enriched with task-specific metadata. PROSE consistently outperforms baselines obtained by adapting state-of-the-art single-image methods to the proposed setting, while requiring neither task-specific supervision nor additional learned components. Project website: https://tev-fbk.github.io/PROSE/