Search papers, labs, and topics across Lattice.
This paper introduces SARAD, a hybrid LLM and DRL framework for autonomous driving that addresses the limitations of unsafe exploration in DRL and latency in LLM inference. SARAD uses RAG-enhanced LLM guidance for exploration, informed by a dynamic knowledge repository, and integrates this prior knowledge into DRL policy optimization via an attention discriminator. The framework also incorporates a collision predictor module fine-tuned on historical data to improve safety, demonstrating significant performance gains in the Highway-Env simulator.
LLMs can safely guide DRL exploration in autonomous driving, leading to faster convergence and improved performance compared to traditional DRL methods.
Ensuring both safety and efficiency in decision-making for autonomous driving systems remains a fundamental challenge. Traditional Deep Reinforcement Learning (DRL) suffers from unsafe random exploration and slow convergence, while Large Language Models (LLMs) demonstrate inherent latency in real-time inference operations. To address these limitations, this paper proposes SARAD, a novel safety-aware hybrid framework that synergizes LLMs and DRL for autonomous driving. SARAD substitutes the random exploration of DRL with Retrieval-Augmented Generation (RAG)-enhanced, LLM-guided decisions sourced from a dynamic expert knowledge repository. An attention discriminator is proposed to integrate the prior knowledge of LLMs into DRL policy optimization. A collision predictor module, fine-tuned with historical collision data, is further designed to improve vehicle safety. Extensive experiments show that SARAD achieves significant performance improvements in the Highway-Env simulator, validating the effectiveness of the proposed model in autonomous driving.
