Search papers, labs, and topics across Lattice.
HERCULES is an open-source simulation framework designed for heterogeneous multi-robot autonomy, enabling the concurrent operation of unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs) in complex, dynamic environments. By leveraging Unreal Engine 5, it overcomes limitations of previous simulators and introduces a waypoint-tracking UGV controller that aligns with UAV control interfaces, facilitating shared navigation and control across platforms. Experimental results demonstrate HERCULES's effectiveness in heterogeneous multi-robot SLAM, collaborative perception, and exploration, with a publicly available benchmark dataset showcasing its capabilities in diverse terrains.
HERCULES transforms multi-robot autonomy by integrating UAVs and UGVs in a single, high-fidelity simulation environment, enabling unprecedented collaborative capabilities.
We present HERCULES, an open-source simulator and data-collection pipeline for heterogeneous multi-robot autonomy. Built upon the Unreal Engine 5 (UE5)-based simulators AirSim and Cosys-AirSim, HERCULES resolves key architectural limitations of prior frameworks to enable concurrent unmanned aerial and ground vehicle (UAV-UGV) operation in large-scale, photorealistic, dynamic environments. It introduces a new waypoint-tracking UGV controller that mirrors existing UAV control interfaces, and provides a shared navigation stack for mapping, traversability analysis, planning, and control across heterogeneous platforms. Expanding inherited sensor suites, it adds physics-based long-wave infrared (LWIR) cameras and configurable night-vision modes for degraded visual environments. HERCULES provides lightweight APIs, ROS 2 wrappers, and rigorous time synchronization across sensors and platforms, and brings state-of-the-art game-engine capabilities into robotics simulation, integrating intelligent agents such as pedestrians, traffic, and wildlife with high-fidelity dynamic phenomena, including fire, flooding, and crop disease spread. HERCULES runs in two modes: passively, replaying offline-designed trajectories to generate reproducible multi-modal datasets, and actively, running an online planner in closed loop from live observations. Our experiments in heterogeneous multi-robot SLAM, collaborative perception, and exploration, using both HERCULES-generated data and active closed-loop execution, demonstrate its utility for advancing heterogeneous multi-robot autonomy. We publicly release our source code, experiment code, documentation, and datasets, including a heterogeneous multi-robot SLAM benchmark collected with two UAVs and two UGVs across kilometer-scale desert, forest, and city environments, at https://lunarlab-gatech.github.io/HERCULES-website.
