Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
This paper addresses the sim-to-real gap in Reinforcement Learning (RL) for Autonomous Surface Vehicles (ASVs) by developing a novel simulator and training pipeline that bypasses the need for explicit System Identification (SysID) of hydrodynamic and thruster parameters. By leveraging only a CAD model and open-water trajectories, the framework learns and refines vehicle dynamics, enabling zero-shot transfer of RL policies to a real BlueBoat ASV for path following and station keeping. The key result is successful real-world deployment without prior knowledge of the vehicle's precise physical characteristics.
ASV RL policies achieve zero-shot sim-to-real transfer by learning dynamics from minimal data, eliminating the need for complex hydrodynamic modeling.
Autonomous Surface Vehicles (ASVs) operating in dynamic marine environments require robust control policies for tasks such as path following and station keeping, making reinforcement learning (RL) a promising alternative to classical controllers. However, existing ASV simulators rarely support parallel environments for RL training. Such existing simulators require accurate hydrodynamic modeling from computational fluid dynamics solvers or towing tank tests for setting hydrodynamic parameters to address the sim-to-real gap. To address these challenges, we present an ASV simulator and accompanying pipeline that enables training policies starting from unknown vehicle dynamics. Our framework uses only a CAD model and brief set of open-water field trajectories for approximating and refining both hydrodynamic and thruster parameters. Real-world deployments on a BlueBoat ASV demonstrate successful zero-shot sim-to-real transfer in path following and station-keeping tasks without prior hydrodynamic and propeller information.