Search papers, labs, and topics across Lattice.
To address the lack of standardized evaluation for heterogeneous multi-robot systems, this work introduces AGOS-Bench, a 7.7k-episode dataset, and a training-free framework for embodied UAV-UGV cooperative visual object search in urban environments. The task requires foundation models to resolve the distinct spatial viewpoints of aerial scouting and ground-level fine-grained target verification. By offloading dynamic coordination to a structured "search-handoff-verify" protocol and utilizing VLMs strictly for visual reasoning, AGOS-Agent improves success rates across eight of nine foundation models, notably boosting Gemini-3.6-Flash's hard-split success rate from 8.6% to 55.7% while cutting decision steps.
Structuring heterogeneous multi-robot coordination into a modular search-handoff-verify protocol skyrockets zero-shot VLM search success from 8.6% to 55.7% on complex urban benchmarks without requiring any model fine-tuning.
Air-Ground Object Search (AGOS) in urban environments is a challenging embodied task, which requires an Unmanned Aerial Vehicle (UAV) and an Unmanned Ground Vehicle (UGV) to jointly search for and verify a specified target vehicle from multi-view visual references. To study this underexplored problem, we introduce AGOS-Bench, the first dedicated benchmark for evaluating whether general-purpose Vision-Language Models (VLMs) can integrate aerial discoveries and ground-level verification through UAV-UGV cooperation. We further provide AGOS-Dataset as the companion resource of exemplary trajectories constructed by an automatic pipeline. It consists of 7.7k episodes for searching objects of diverse categories and attributes, spanning three difficulty levels. To address the AGOS task, we propose AGOS-Agent, a training-free and tool-augmented approach. The agentic method relieves VLMs from complex and dynamic coordination via a deliberate search-handoff-verify cooperation protocol, only demanding VLMs for scene understanding and decision-making. Extensive experiments on nine VLMs show that AGOS-Agent improves overall success rate for eight of the nine evaluated backbones while reducing decision steps for all nine. On the hard split, the SR and SPL of Gemini-3.6-Flash increase from 8.6% to 55.7% and from 7.6% to 44.0%, respectively.
