Search papers, labs, and topics across Lattice.
This paper introduces MultiUAV-Plat, a simulation platform designed to evaluate large language model (LLM) performance in multi-UAV collaborative task planning, addressing the limitations of existing UAV simulators that overlook aerial-robotics constraints. The platform features a comprehensive benchmark with 75 mission sessions and nearly 10,000 validation checks, enabling realistic task execution through agent interactions rather than privileged access. The proposed Agent4Drone framework significantly outperforms a ReAct baseline, achieving a 57.9% task pass rate and reducing failed task rates from 32.4% to 12.9%, highlighting the effectiveness of LLMs in complex UAV coordination tasks.
Agent4Drone's innovative approach to structuring multi-UAV behavior leads to a dramatic reduction in task failures, showcasing the potential of LLMs in aerial robotics.
Large language models (LLMs) provide a promising interface for high-level robotic task planning, but their use in multi-UAV collaboration remains difficult to evaluate systematically. Existing UAV simulators mainly emphasize dynamics, perception, or low-level control, while existing LLM-agent benchmarks rarely capture aerial-robotics constraints such as partial observability, spatial coverage, UAV assignment, and multi-vehicle coordination. To bridge this gap, we present MultiUAV-Plat, a lightweight, easy-to-use, LLM-agent-oriented simulation platform for multi-UAV collaborative task planning. The platform exposes concise RESTful APIs, agent-facing observations, role-based information access, hidden validation logic, and optional 2D/3D visualization, allowing agents to solve missions through realistic tool interaction rather than privileged simulator access. Built on this platform, the MultiUAV-Plat Benchmark contains 75 mission sessions, 1500 natural-language tasks, and 9396 validation checks across target assignment, area search, and area assignment and patrol scenarios. We further propose Agent4Drone, a task-specific LLM agent framework that structures multi-UAV behavior into memory, observation, task understanding, planning, execution, and verification. In a full paired benchmark comparison, Agent4Drone achieves a 57.9% task pass rate, a 74.6% average task check pass rate, and a 72.0% global check pass rate, substantially outperforming a ReAct baseline at 30.6%, 47.9%, and 43.1%, respectively. Agent4Drone also reduces the total failed task rate from 32.4% to 12.9%. These results demonstrate that MultiUAV-Plat and MultiUAV-Plat Benchmark provide a reproducible foundation for studying LLM-driven multi-UAV autonomy under realistic information and execution constraints.
