Search papers, labs, and topics across Lattice.
This paper introduces an adaptive reinforcement learning approach for trajectory tracking in autonomous surface vehicles that enables zero-shot deployment across different platforms using a single policy. By conditioning on interaction history and utilizing a teacher-student architecture to infer latent representations of platform dynamics, the method effectively generalizes to unknown dynamics. In real-world tests, the adaptive policy achieves up to 58% improvement in position mean absolute error compared to non-adaptive baselines, rivaling the performance of platform-specific tuned controllers.
Zero-shot deployment of a single adaptive policy across diverse autonomous surface vehicles can outperform traditional platform-specific controllers by a significant margin.
Autonomous surface vehicles vary widely in hydrodynamic and actuation characteristics, yet most controllers are designed for single-platform deployment. We present an adaptive reinforcement learning approach for trajectory tracking that enables zero-shot cross-platform deployment using a single policy. Since the deployment platform's dynamics are unknown to the policy, we address cross-platform generalization with the standard partial-observability approach of conditioning on interaction history, employing a teacher-student architecture in which a learned module infers a latent representation of the platform dynamics. The policy is trained in simulation under randomized vessel dynamics and is deployed zero-shot to two real-world platforms without any fine-tuning, despite relying on a simple analytical dynamics model rather than a high-fidelity hydrodynamic simulator. In real-world experiments on two different platforms, the adaptive policy outperforms non-adaptive learning-based baselines by up to 58% in position mean absolute error while approaching the tracking accuracy of a platform-specific tuned controller.