Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces RoG-DAgger, a novel post-training framework that enhances end-to-end driving systems by addressing the limitations of traditional DAgger methods. By utilizing short-horizon kinematic rollouts, RoG-DAgger generates high-quality expert demonstrations in safety-critical states, expands the expert's trajectory-and-speed solution space, and optimally times the takeover to prevent failures. The results show significant improvements in driving performance, with a 5.3-point increase in driving score and a 6.2 percentage point rise in success rate on the Bench2Drive benchmark, alongside substantial gains on other evaluation metrics.
RoG-DAgger boosts end-to-end driving performance by leveraging kinematic rollouts to create expert demonstrations that prevent critical failures.
Recent end-to-end driving systems demonstrate strong performance on closed-loop benchmarks, yet are still predominantly trained on fixed expert-collected data using open-loop imitation learning. This training-inference mismatch leaves the policy vulnerable in policy-induced states, where accumulated errors can lead to safety-critical failures. A promising post-training approach to overcome this issue is Dataset Aggregation (DAgger), which gathers expert demonstrations in policy-induced states and subsequently fine-tunes the policy on the resulting aggregated dataset. Existing driving DAgger pipelines, however, face three challenges: i) the expert is restricted to a limited trajectory-and-speed solution space, ii) takeover may occur too early or too late relative to impending failures, and iii) privileged expert decisions may rely on information unavailable to the student. To address this, we introduce RoG-DAgger, a post-training framework that uses short-horizon kinematic rollouts to construct high-quality expert demonstrations in safety-critical states. Specifically, RoG-DAgger expands the expert's trajectory-and-speed solution space and evaluates candidate plans through rollout to construct preventive supervision. Moreover, it uses rollout solvability to time the takeover near the estimated point of no return. Lastly, it aligns the expert's field of view with that of the student to provide student-compatible supervision. Across in-distribution (including long-horizon) and out-of-distribution evaluations, RoG-DAgger improves the end-to-end model SimLingo by 5.3 driving-score points and 6.2 percentage points in success rate on Bench2Drive, doubles its driving score from 22 to 44 on Longest6 v2, and improves out-of-distribution success rate from 55\% to 66\% on Fail2Drive.