Search papers, labs, and topics across Lattice.
This paper introduces Correction-in-the-Loop Sample-Efficient Reinforcement Learning (CIL-SERL), a novel RL framework for end-to-end autonomous parking trained entirely within a photorealistic 3D Gaussian Splatting (3DGS) simulator. CIL-SERL employs a multi-level replay buffer that hierarchically organizes standard RL rollouts, human corrective interventions, failed exploration trajectories, and rollback-based correction segments. Experiments in simulation and on a physical vehicle demonstrate that CIL-SERL significantly improves parking success rate, efficiency, and safety compared to standard RL approaches.
Forget tedious expert demonstrations: this RL approach learns autonomous parking by smartly incorporating human corrections and failed attempts, achieving impressive real-world performance.
Autonomous parking demands precise low-speed maneuvering within narrow, cluttered, and highly constrained environments, where vehicles must navigate tight spaces while avoiding static obstacles and complex geometric boundaries. Unlike imitation learning, which typically requires massive volumes of high-quality expert demonstrations to converge to a stable policy and often suffers from limited generalization to unseen scenarios, traditional reinforcement learning (RL) methods face persistent challenges including excessive training overhead, inefficient exploration, and even failure to learn viable parking strategies in challenging settings. To address these limitations, this paper presents a correction-in-the-loop sample-efficient reinforcement learning (CIL-SERL) framework for end-to-end autonomous parking, which is entirely trained in a photorealistic 3D Gaussian Splatting (3DGS) parking simulator that enables high-fidelity digital reconstruction of real-world scenes. Inspired by error-correction notebooks used in learning practice, we design a novel multi-level replay buffer mechanism. These buffers hierarchically organize and store standard RL rollouts, human corrective interventions, failed exploration trajectories, and rollback-based correction segments in separate yet interconnected memory regions, facilitating structured sampling and targeted learning during training. The proposed framework is systematically evaluated in both the 3DGS simulation environment and a physical vehicle platform. Extensive experimental results demonstrate that our method achieves substantial improvements in parking success rate, operational efficiency, and safety performance across diverse scenarios, validating the effectiveness and practical applicability of the proposed CIL-SERL-based end-to-end autonomous parking solution.
Tsinghua AI