Search papers, labs, and topics across Lattice.
This paper introduces a hierarchical reinforcement learning framework for UAV search-and-rescue missions, combining a rule-based high-level advisor with a goal-conditioned low-level RL controller. The rule-based advisor provides interpretable guidance, while the low-level controller learns online with a mode-aware prioritized replay mechanism. Results on battery-aware multi-goal delivery and moving-target delivery tasks demonstrate improved early safety and sample efficiency by reducing collisions, without pretraining.
Rule-based high-level coaching can drastically improve the safety and sample efficiency of goal-conditioned RL agents in UAV missions, even without pretraining.
This paper presents a hierarchical decision-making framework for unmanned aerial vehicle (UAV) missions motivated by search-and-rescue (SAR) scenarios under limited simulation training. The framework combines a fixed rule-based high-level advisor with an online goal-conditioned low-level reinforcement learning (RL) controller. To stress-test early adaptation, we also consider a strict no-pretraining deployment regime. The high-level advisor is defined offline from a structured task specification and compiled into deterministic rules. It provides interpretable mission- and safety-aware guidance through recommended actions, avoided actions, and regime-dependent arbitration weights. The low-level controller learns online from task-defined dense rewards and reuses experience through a mode-aware prioritized replay mechanism augmented with rule-derived metadata. We evaluate the framework on two tasks: battery-aware multi-goal delivery and moving-target delivery in obstacle-rich environments. Across both tasks, the proposed method improves early safety and sample efficiency primarily by reducing collision terminations, while preserving the ability to adapt online to scenario-specific dynamics.
