Search papers, labs, and topics across Lattice.
The paper introduces Semantic Anchored Functional Maps (SemFM), a method for transferring affordances from a single visual demonstration across geometrically diverse object instances with similar functionality. SemFM identifies semantically corresponding functional regions, selects semantic anchors, and uses a functional map to propagate these constraints, establishing a dense, semantically consistent correspondence between objects. Experiments on synthetic objects and real-world robotic manipulation demonstrate accurate affordance transfer with low computational cost.
Generalizing robot skills across geometrically diverse objects is now more practical: SemFM enables affordance transfer from a single visual demonstration by establishing dense, semantically consistent correspondence between object instances.
Traditional learning from demonstration (LfD) generally demands a cumbersome collection of physical demonstrations, which can be time-consuming and challenging to scale. Recent advances show that robots can instead learn from human videos by extracting interaction cues without direct robot involvement. However, a fundamental challenge remains: how to generalize demonstrated interactions across different object instances that share similar functionality but vary significantly in geometry. In this work, we propose \emph{Semantic Anchored Functional Maps} (SemFM), a framework for transferring affordances across objects from a single visual demonstration. Starting from a coarse mesh reconstructed from an image, our method identifies semantically corresponding functional regions between objects, selects mutually exclusive semantic anchors, and propagates these constraints over the surface using a functional map to obtain a dense, semantically consistent correspondence. This enables demonstrated interaction regions to be transferred across geometrically diverse objects in a lightweight and interpretable manner. Experiments on synthetic object categories and real-world robotic manipulation tasks show that our approach enables accurate affordance transfer with modest computational cost, making it well-suited for practical robotic perception-to-action pipelines.
