Search papers, labs, and topics across Lattice.
This paper introduces PlanRL, a novel trajectory planning architecture that integrates reinforcement learning (RL) with a polynomial-based trajectory planner to enhance the interpretability and performance of driving experts in autonomous vehicles. By utilizing a Frenet-frame coordinate system, the method simplifies complex road geometries, allowing for more effective policy learning while ensuring kinematic feasibility to reduce tracking errors. Evaluated on CARLA benchmarks, PlanRL outperforms existing control-based RL experts, achieving significant improvements in driving scores and success rates across multiple metrics.
Trajectory planning can boost RL-based driving performance by over 11% while enhancing interpretability and reducing errors.
Reinforcement learning (RL) has become a prominent framework for developing driving experts in autonomous vehicles. However, most existing RL-based experts are designed to output direct control commands (e.g., throttle, steering), which suffer from a lack of interpretability, high spatial complexity in learning road geometries, and poor compatibility with modern end-to-end planning architectures. To address these limitations, we propose a novel trajectory planning architecture for RL driving experts that integrates an RL policy with a polynomial-based trajectory planner. By employing a Frenet-frame coordinate system, our method simplifies complex road geometries into a curvilinear framework, offering a structured coordinate prior that facilitates policy learning. Furthermore, we incorporate a kinematic feasibility check into the planning stage to ensure that generated trajectories remain within the vehicle's physical limits, effectively mitigating cumulative tracking errors typically found in planning-based systems. We evaluate our approach on key CARLA benchmarks, where it significantly outperforms existing state-of-the-art control-based RL experts. On the CARLA Offline Leaderboard v1 and NoCrash benchmarks, our method improves the driving score by 5% and 11%, respectively, and increases the success rate by 8% and 19%.
