Search papers, labs, and topics across Lattice.
This paper introduces a language-driven framework for optimizing cost functions in autonomous driving, allowing vehicles to adapt their driving behavior based on user preferences and evolving traffic conditions. By leveraging a Large Language Model (LLM) to interpret both structured scenario descriptions and natural language queries, the system generates parameters for a risk-aware Model Predictive Path Integral (MPPI) controller. Evaluation in realistic driving scenarios shows that the framework effectively aligns vehicle behavior with user intentions, facilitating a more intuitive interaction between autonomous systems and their operators.
Language-driven cost optimization enables autonomous vehicles to adapt their driving behavior intuitively, bridging the gap between technical complexity and user preferences.
The driving behavior of autonomous vehicles is typically governed by the cost function of their motion planner, which encodes objectives such as speed tracking, smoothness, lane keeping, and collision avoidance. However, tuning the parameters that shape this cost function is a challenging task that requires technical expertise, limiting the vehicle's ability to adapt to evolving traffic scenarios or end-user preferences. This work presents a language-driven framework for adaptive cost design in autonomous driving. A Large Language Model (LLM) interprets structured scenario descriptions and natural language user queries to generate the parameters applied to a risk-aware Model Predictive Path Integral (MPPI) controller. The system incorporates a human-in-the-loop validation stage in which the proposed behavioral changes are described in non-technical language and confirmed prior to deployment. Users may additionally provide feedback either before or after deployment, enabling iterative refinement of the vehicle's motion behavior. The framework is evaluated across multiple queries in realistic driving scenarios to assess its effectiveness. Simulation results demonstrate that the method successfully induces behavioral changes that align with the intended requirements in an intuitive manner, thereby bridging the gap between intelligent vehicle control systems and end users.
