Search papers, labs, and topics across Lattice.
This paper introduces RelAfford6D, a training-free framework that utilizes a Relational 6D Affordance Graph to connect abstract semantic instructions with precise physical control in robotic manipulation. By transforming topological nodes into metric $SE(3)$ poses through vision foundation models, the system formulates the execution of tasks as a kinematic constraint satisfaction problem, enabling the robot to generate continuous trajectories while adhering to defined physical constraints. The approach demonstrates significant improvements in zero-shot success rates and generalization across categories, outperforming traditional data-driven methods in both simulated and real-world scenarios.
Achieving superior zero-shot success rates, RelAfford6D redefines robotic manipulation by seamlessly linking abstract instructions to precise physical actions without the need for extensive training.
Bridging abstract semantics and precise physical control remains a fundamental challenge in open-world robotic manipulation. While recent data-driven policies show promise, their reliance on isolated contact points or latent affordance embeddings lacks the rigorous kinematic constraints necessary for complex articulated objects.To overcome the limitation, we introduce RelAfford6D, a novel training-free framework centered on a Relational 6D Affordance Graph. Given a free-form instruction, our system deduces a semantic topology linking a primary interacting part to its physical anchor. By elevating these topological nodes into precise metric $SE(3)$ poses via vision foundation models, we analytically formulate downstream execution as a kinematic constraint satisfaction problem. The robot synthesizes continuous trajectories by tracking strictly defined physical manifolds (e.g., revolute or prismatic orbits). Coupled with a closed-loop tracking mechanism for dynamic replanning against disturbances, our physically grounded approach achieves superior zero-shot success rates, cross-category generalization and execution robustness in both simulation and the real world environments, outperforming existing data-driven baselines.
