Search papers, labs, and topics across Lattice.
This paper introduces a novel framework for training an autonomous superbike racing agent using a combination of Soft Actor-Critic (SAC) and Self-Paced Curriculum Deep Reinforcement Learning (SPDL) in a physics-accurate simulation environment. The approach dynamically generates increasingly challenging tasks based on the agent's performance, allowing for efficient learning without manual curriculum design. Experimental results show that SPDL significantly enhances training efficiency, lap times, and stability compared to traditional SAC methods, setting a new benchmark for RL in two-wheeled vehicle dynamics.
SPDL not only accelerates learning for autonomous superbike racing but also establishes a crucial baseline for future RL applications in complex two-wheeled dynamics.
Autonomous Racing has seen remarkable progress through deep Reinforcement Learning (RL), primarily for four-wheeled vehicles. However, motorbikes introduce substantially greater complexity due to the need to manage balance and lean angle, in addition to more reactive steering and throttle control, and a smaller weight. In this work, we present a framework for training an autonomous agent to race a superbike in VRider SBK, a physics-accurate Unity-based motorbike simulator. Our approach integrates Soft Actor-Critic (SAC) with Self-Paced curriculum Deep reinforcement Learning (SPDL), which dynamically generates progressively more challenging tasks based on the agent's performance, without requiring manual curriculum design. The agent's state space comprises proprioceptive features extended with lean-angle history, along with global track features via course points. The reward signal is shaped to encourage progress along the track while penalizing instability-inducing behaviors specific to two-wheeled dynamics. Preliminary experimental results demonstrate that SPDL outperforms SAC alone in training efficiency, lap time, and driving stability across multiple tracks and motorbike models, establishing a first baseline for RL-based autonomous motorbike racing.
