Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
This paper introduces Execution-Interface Dynamics Adaptation (EIDA) to address the sim-to-real gap in robot navigation by directly modeling the discrepancies between simulated and real-world velocity command execution and feedback. EIDA fits models of body-frame pose increments and velocity feedback from target-platform data, enabling a lightweight simulator to better match real-world dynamics without explicit actuator modeling. This approach significantly reduces prediction errors and achieves superior navigation performance on physical robots and in simulation benchmarks.
Real-world robot navigation policies can achieve near-perfect sim-to-real transfer by directly learning the "interface" between velocity commands and observed feedback, bypassing complex actuator dynamics.
Simulation-to-robot transfer can fail when velocity commands produce motion and feedback that differ from those modeled during policy training. We present execution-interface dynamics adaptation (EIDA), which fits these responses from target-platform execution data without reconstructing actuator dynamics. A model of body-frame pose increments updates simulator geometry, while a separate model predicts the velocity feedback observed by the policy; a short history of velocity feedback is included in the policy input. The fitted models are used within a lightweight GPU-parallel simulator. On the full Jackal and Go2 validation sets, the fitted models reduced position and yaw prediction errors relative to the simulator's predefined motion model. Across 100 benchmark navigation environments evaluated in a separate physics-based simulator, EIDA achieved the highest success rate and navigation score among the compared learned policies, both with and without global guidance. Feedback ablations further supported the need to match policy-facing velocity estimates. On a physical Unitree Go2, EIDA reached the goal without collision in all 20 static-scene trials, compared with 4 of 20 for the baseline. These results show that execution-interface adaptation can improve navigation transfer without detailed actuator simulation.