Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a Continual Reinforcement Learning (RL) framework utilizing Continual Backpropagation to train a generalistic policy for autonomous racing on the RoboRacer platform. By leveraging real-world data, the proposed method can fine-tune the policy within 15 minutes to outperform traditional controllers, effectively addressing the challenge of adapting to new track-floor combinations. Additionally, the authors conduct a simulation analysis comparing their approach to offline RL, highlighting the plasticity properties of their method in dynamic environments.
Fine-tuning a generalistic policy for autonomous racing can be achieved in just 15 minutes, outperforming classical controllers with minimal new experience.
A key challenge in modern robotics is to adapt to changing environments, a challenge that is exacerbated when simulations cannot encompass every possible real-world configuration, and therefore Reinforcement Learning (RL) in the physical world becomes necessary. Continual Reinforcement Learning provides the tools to address this challenge; however, both the frameworks and the methods remain underexplored. Autonomous Racing and in particular the RoboRacer competition provide a testing ground for such methods, as learning to drive on a new track-floor combination with the least amount of new experience naturally frames a continual learning problem. This work tries to address this gap by proposing a continual RL framework based on Continual Backpropagation that is able, with only real-world data, to train a generalistic policy on a set of tracks and then fine- tune it within 15 minutes to outperform classical controllers. Furthermore, a comparison method based on offline RL is proposed, and a simulation analysis of the plasticity properties of the methods is conducted.