Search papers, labs, and topics across Lattice.
This paper introduces a multi-agent deep reinforcement learning framework designed to enhance cooperative navigation for UAVs in complex environments by addressing challenges such as local optima, sparse rewards, and generalization issues. Key innovations include a perception mechanism for proactive local optima detection, a hierarchical collaborative demonstration buffer for improved learning from sparse signals, and a safety-aware curriculum scheduling that mitigates catastrophic forgetting. The framework demonstrates robust adaptability and strong performance across various metrics, including collaboration success rates and zero-shot generalization in dynamic environments.
Local optima can be proactively escaped, leading to a 30% increase in collaboration success rates among UAVs in complex navigation tasks.
Cooperative navigation of multi-agent UAVs in complex environments faces key challenges including local optima traps, sparse rewards, learning imbalance among agents, and insufficient cross-scenario generalisation. This paper proposes a multi-agent deep reinforcement learning framework that addresses these issues through coordinated exploration, demonstration exploitation, safe curriculum scheduling, and structure-aware generalisation. First, a perception mechanism combining memory of visited states, directional novelty estimates, and penalty backpropagation enables agents to proactively detect and escape local optima. Second, a hierarchical collaborative demonstration buffer with tiered behaviour cloning manages trajectories by degree of team collaboration and applies differential supervision to the actor network, improving demonstration utilisation under sparse collaborative signals. Third, a safety-aware dual-condition curriculum scheduling mechanism reviews mastered scenarios through back-testing and experience pre-filling during training, suppressing catastrophic forgetting while ensuring both task performance and flight safety. For generalisation, local geometric features computed from sensor readings are abstracted into a domain parameter, through which a structure-aware gating network and mixture-of-experts mechanism condition the policy on local structural patterns rather than scenario-specific coordinates, enabling cross-scenario transfer without exposure to the target environment. The framework is further validated under mixed static-dynamic obstacle settings, showing robust adaptability to dynamic disturbances. Simulation results confirm strong performance in collaboration success rate, navigation robustness, zero-shot cross-scenario generalisation, and dynamic environment adaptability.
