Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces self-aware guided exploration (SAGE), an active learning framework designed to enhance the adaptability of autonomous driving systems by allowing them to recognize their competence limits and seek assistance when necessary. SAGE employs a predictive world model that generates intrinsic signals—fear and curiosity—to guide the agent's exploration and decision-making, enabling it to manage risk and improve through focused imitation learning on critical encounters. Evaluated across various simulated and real-world scenarios, SAGE demonstrates significant improvements in robustness and safety while maintaining performance levels comparable to established baseline policies.
Agents can now learn from their mistakes in real-time, improving safety and performance in autonomous driving by recognizing when to seek expert intervention.
Learning-based autonomous driving (AD) systems can perform reliably in familiar conditions, yet rare distribution shifts and long-tail events remain a major source of abrupt failure. A central limitation is that most agents learn primarily from passive experience and lack mechanisms to estimate when their competence is insufficient, seek timely assistance, and convert safety-critical encounters into targeted improvement. Here we present self-aware guided exploration (SAGE), an active learning framework for post-training adaptation in AD. SAGE learns a predictive world model that generates two online intrinsic signals: fear, which estimates short-horizon predictive risk and model uncertainty, and curiosity, which measures novelty through prediction error. Curiosity adaptively calibrates the intervention threshold for fear, allowing the agent to regulate risk in a context-dependent manner. When predicted fear exceeds this adaptive threshold, the agent transfers control to an expert or fallback policy and uses the resulting takeover trajectories for focused imitation learning. In parallel, fear is integrated into policy optimization and evaluation as a safety-oriented constraint to reduce performance regressions during adaptation. We evaluate SAGE in simulated route-transfer tasks, Waymo-based logged driving scenarios, CARLA occlusion hazards, and real-world mobile robot navigation tests. Across these settings, SAGE improves robustness in novel and safety-critical scenarios, reduces safety violations, and maintains task performance comparable to strong baseline policies. These results suggest that agents can improve after initial training by estimating the limits of their competence, requesting guidance when needed, and learning selectively from rare high-value events.