Search papers, labs, and topics across Lattice.
This paper introduces GAPL, a novel framework for trajectory planning in autonomous driving that leverages Large Language Models (LLMs) to enhance both high-level reasoning and low-level control. By integrating an LLM-based effect evaluator, a simulation-based effect grounder, and an effect-aware decision maker, GAPL effectively addresses issues of hallucination, grounding, and numerical precision in LLMs. Experimental results across four Highway-env scenarios reveal that GAPL significantly reduces collision rates and displacement errors while improving overall reward performance compared to existing baselines.
GAPL achieves a remarkable reduction in collision rates and displacement errors, showcasing the potential of LLMs in trajectory planning for autonomous driving.
Trajectory planning for autonomous driving requires both high-level reasoning and precise low-level control. Large Language Models (LLMs) offer semantic-rich planning capabilities, however, their application is limited by hallucinated reasoning, poor grounding in environment dynamics, and limited numerical precision in control. We propose GAPL (Grounded Action-effect Policy Learning), a unified framework that integrates LLM-based effect estimation, simulation-based effect grounding, and policy optimization into a closed-loop system. GAPL consists of three modules: (1) an LLM-based Effect Evaluator for structured multi-dimensional action-effect estimation; (2) a Simulation-based Effect Grounder that predicts dynamics-consistent effects from simulator rollouts; and (3) an Effect-Aware Decision Maker that grounds LLM effect estimates against simulation via a distiller to guide Proximal Policy Optimization (PPO)-based policy learning. Experiments on four Highway-env scenarios demonstrate that GAPL consistently outperforms baselines, achieving average reductions of {0.76, 0.86, 2.00} in collision rate, average displacement error (ADE), and final displacement error (FDE), and an average reward gain of 1.44.
