Search papers, labs, and topics across Lattice.
This paper introduces EmbodiSteer, a framework that enhances embodiment-agnostic visuomotor policies by integrating joint-space guidance for zero-shot deployment across diverse robotic platforms. By maintaining policy learning in Cartesian space while utilizing forward kinematics and Jacobian updates for collision-aware steering, the approach significantly mitigates the brittleness of Cartesian-only policies. The results demonstrate a 46.1% reduction in collision rates and a 28.5% increase in task success rates in simulations, with even greater improvements observed in physical robot deployments.
Steering embodiment-agnostic policies with joint-space guidance can slash collision rates by over 90% in real-world robotic tasks.
Scalable robot imitation learning relies on large-scale heterogeneous data from diverse robots or body-free data, making Cartesian end-effector actions a key interface for embodiment-agnostic policy learning. However, end-effector-only abstraction leaves Cartesian policies unaware of the deployed robot body, making them brittle under robot-specific constraints such as whole-body collision avoidance. To overcome this limitation, we present EmbodiSteer, a training-free framework that steers embodiment-agnostic visuomotor policies toward zero-shot, embodiment-aware deployment. EmbodiSteer keeps policy learning in Cartesian space while efficiently lifting inference-time diffusion sampling into the target robot's joint space via forward kinematics and Jacobian-based updates. With whole-body collision-aware guidance over joint trajectories after each denoising step, the arm can be steered away from collisions while preserving learned end-effector behavior. Compared with Cartesian-only execution, EmbodiSteer reduces collision rate by 46.1% and improves task success rate by 28.5% across 9 simulated robots, and further achieves 90.0% collision rate reduction and 36.7% success rate increase on two physical robots in highly constrained scenarios. Our project page is at https://frankwang67.github.io/EmbodiSteer-Page.