Search papers, labs, and topics across Lattice.
This paper introduces a novel safe transfer reinforcement learning framework specifically designed for autonomous highway lane changing, addressing the challenges of transfer mismatch and risky exploration. By implementing an adaptive teacher intervention mechanism and a teacher-guided safe transfer module, the authors enhance training safety and efficiency, achieving significant performance improvements. Experimental results demonstrate that their approach surpasses baseline methods by over 52.2% in safety and 5.0% in learning efficiency across varied traffic conditions.
A safe transfer learning framework that boosts autonomous lane changing performance by over 52% in safety while enhancing learning efficiency.
Transfer learning improves policy learning efficiency by reusing knowledge from source tasks, providing a feasible paradigm for safe and efficient autonomous highway lane changing decision-making. Existing methods frequently encounter transfer mismatch induced by distribution shifts between source and target domains, leading to training oscillation and performance decline. Besides, target domain adaptation depends on exploratory interactions, which struggles to guarantee training safety in safety-critical lane changing cases. To tackle these limitations, this paper proposes a safe transfer reinforcement learning framework for autonomous highway lane changing. First, we design an adaptive teacher intervention mechanism based on instantaneous safety cost to restrain risky exploration and fade intervention strength progressively, with theoretical analysis on return bounds for mixed behavior policy. This intervention also produces dual-source samples for joint training. Second, a teacher-guided safe transfer module embeds action evaluation information of teacher policy into student learning via reward shaping to boost training safety and efficiency, with teacher guidance decaying as policy safety rises. Third, a teacher-guided weighted optimization mechanism adjusts sample weights in policy optimization using a likelihood ratio factor to stabilize transfer performance. Experiments under varied traffic densities and validations on real-world NGSIM dataset reveal that our method surpasses baseline approaches by over 52.2% in safety and 5.0% in learning efficiency. Results verify the efficacy and robustness of our safety-aware transfer strategy for autonomous highway lane changing under various traffic conditions.
