Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a vision-based framework for leader-follower formation control in multi-UAV systems that operates effectively in GPS-degraded environments. By employing a lightweight YOLO-based detector trained on drone-specific data, the follower UAV can accurately detect and localize the leader UAV in real-time using an RGB-D camera. The results demonstrate that the system maintains stable formations even under sensor noise and communication dropouts, highlighting its practical applicability for real-world UAV operations when traditional localization fails.
Vision-based leader-follower control enables UAVs to maintain formation even when GPS fails, ensuring mission continuity in challenging environments.
Cooperation in multi-UAV systems requires reliable relative perception so that follower vehicles can maintain formation and continue their mission safely even when absolute positioning sensors degrade or fail. This paper presents a vision-based cooperative formation framework running on a follower UAV that uses a front-facing RGB-D camera to detect, track, and localize a leader UAV in real-time. A lightweight YOLO-based detector is trained on a dedicated drone dataset and deployed onboard to predict leader bounding boxes, which are then fused with depth information via a pinhole camera model to estimate the leader's relative pose. These estimates provide a leader-follower position controller and can also be used as a backup when GPS or external localization is unavailable. This framework is implemented as a set of ROS nodes and evaluated in a physics-based multi-UAV simulation built on XTDrone, with sensor noise and communication dropouts. We evaluate detection accuracy, runtime, and formation-keeping error under nominal conditions and under simulated failures of the positioning sensors. The results show that the proposed framework maintains stable leader-follower formations with reasonable computational cost and provides a practical basis for extending vision-based cooperative formation control to real-world multi-UAV systems.