Search papers, labs, and topics across Lattice.
This paper introduces SCAPO, a self-supervised framework for category-level articulated pose estimation that operates from a single RGB-D observation without the need for ground-truth labels or category-specific models. By employing an SE(3)-equivariant vector-neuron autoencoder, SCAPO effectively disentangles global pose from instance-specific geometry, enabling the alignment of diverse object instances into a shared canonical space. The method achieves superior performance on both synthetic and real datasets, recovering consistent part structures and accurate articulation parameters, outperforming existing self-supervised approaches.
SCAPO achieves accurate articulated pose estimation from a single 3D observation without any ground-truth supervision, setting a new benchmark in self-supervised learning for articulated objects.
Existing methods for category-level object articulation from a single 3D observation often rely on dense supervision, multi-frame inputs, or CAD templates, and still struggle to disentangle geometry from articulation or to recover explicit joint parameters. We propose SCAPO, a self-supervised framework that estimates canonical geometry, rigid part segmentation, and joint pivots, axes, and articulation states from a single RGB-D observation without ground-truth labels or category-specific models. Our SCAPO first uses an SE(3)-equivariant vector-neuron autoencoder to factor out global pose and align diverse instances into a shared canonical space. On this aligned shape, a joint-aware blend-skinning module is then designed to model part motion. We learn this representation through cycle reconstruction between observed and canonical shapes and cross-space alignment with a learnable canonical template that decouples shared category geometry from instance-specific residual shape. Experiments on synthetic and real articulated-object datasets show that our SCAPO recovers consistent part structure and accurate articulation parameters and outperforms all self-supervised baselines.
NUS