Search papers, labs, and topics across Lattice.
This paper introduces GRAFT, a novel framework that enhances zero-shot robotic manipulation by leveraging geometry-aware part correspondence for unseen objects. By representing objects as part-based graphs, GRAFT facilitates the retrieval of functionally and geometrically similar instances using only a single demonstration per object, addressing the limitations of prior semantic-only approaches. The key result shows that GRAFT effectively propagates contact points through point-wise correspondence, significantly improving manipulation success in few-shot scenarios.
GRAFT enables robots to manipulate unseen objects with just one demonstration by leveraging geometric similarities, outperforming traditional semantic retrieval methods.
Generalizing robotic manipulation to unseen objects remains challenging, as learning-based approaches require many demonstrations and fail in few-shot settings. Prior work transfers affordances through semantic retrieval, but semantics alone neglect geometric similarity, which is critical for manipulation. We propose GRAFT, a geometry-aware correspondence framework for zero-shot manipulation transfer using only one demonstration per object. Objects are represented as part-based graphs, where part-level descriptors support global instance retrieval and part correspondence, and vertex-level descriptors enable fine-grained contact point matching. For an unseen object, our method first retrieves the most functionally and geometrically similar instance from the demonstration buffer with aligned functional parts, and finally propagates the contact points through point-wise correspondence.
NVIDIA