Search papers, labs, and topics across Lattice.
This paper introduces a framework for natural language (NL) navigation of UAVs by translating NL instructions into Signal Temporal Logic (STL) specifications and synthesizing trajectories using mixed-integer linear programming (MILP). To improve the accuracy and validity of NL-to-STL translation, the authors develop a reasoning-enhanced large language model (LLM) trained with chain-of-thought (CoT) supervision and group-relative policy optimization (GRPO). They also implement a specification repair mechanism that uses MILP-based diagnosis and LLM-guided semantic reasoning to resolve infeasibilities while maintaining safety, validated through simulations and real-world flight tests.
LLMs can now translate natural language commands into provably safe UAV flight plans, even repairing infeasible specifications on the fly.
Natural language (NL) navigation for low-altitude unmanned aerial vehicles (UAVs) offers an intelligent and convenient solution for low-altitude aerial services by enabling an intuitive interface for non-expert operators. However, deploying this capability in urban environments necessitates the precise grounding of underspecified instructions into safety-critical, dynamically feasible motion plans subject to spatiotemporal constraints. To address this challenge, we propose a unified framework that translates NL instructions into Signal Temporal Logic (STL) specifications and subsequently synthesizes trajectories via mixed-integer linear programming (MILP). Specifically, to generate executable STL formulas from free-form NL, we develop a reasoning-enhanced large language model (LLM) leveraging chain-of-thought (CoT) supervision and group-relative policy optimization (GRPO), which ensures high syntactic validity and semantic consistency. Furthermore, to resolve infeasibilities induced by stringent logical or spatial requirements, we introduce a specification repair mechanism. This module combines MILP-based diagnosis with LLM-guided semantic reasoning to selectively relax task constraints while strictly enforcing safety guarantees. Extensive simulations and real-world flight experiments demonstrate that the proposed closed-loop framework significantly improves NL-to-STL translation robustness, enabling safe, interpretable, and adaptable UAV navigation in complex scenarios.
