Search papers, labs, and topics across Lattice.
The paper introduces LAD, a real-time language-action planner for autonomous driving that generates motion plans and textual reasoning. LAD achieves a ~3x latency reduction compared to previous language models and sets a new state-of-the-art on nuPlan benchmarks. The authors further combine LAD with RAD, a rule-based planner, to create a hybrid system that leverages the reliability of rules and the adaptability of language for improved autonomous driving.
Real-time autonomous driving with language models is now possible, achieving 3x speedup and state-of-the-art performance by combining learned and rule-based planning.
We present LAD, a real-time language--action planner with an interruptible architecture that produces a motion plan in a single forward pass (~20 Hz) or generates textual reasoning alongside a motion plan (~10 Hz). LAD is fast enough for real-time closed-loop deployment, achieving ~3x lower latency than prior driving language models while setting a new learning-based state of the art on nuPlan Test14-Hard and InterPlan. We also introduce RAD, a rule-based planner designed to address structural limitations of PDM-Closed. RAD achieves state-of-the-art performance among rule-based planners on nuPlan Test14-Hard and InterPlan. Finally, we show that combining RAD and LAD enables hybrid planning that captures the strengths of both approaches. This hybrid system demonstrates that rules and learning provide complementary capabilities: rules support reliable maneuvering, while language enables adaptive and explainable decision-making.
