Search papers, labs, and topics across Lattice.
This paper introduces a hierarchical navigation framework for quadrotors to perform Instance-Specific Image-Goal Navigation (InstanceImageNav), addressing challenges like continuous 3D control and limited field of view. By generating viewpoint-aware action nodes and utilizing a lightweight semantic memory, the system effectively maintains context and selects optimal navigation paths toward depicted objects. Experimental results show significant performance improvements in both simulated environments and real-world quadrotor flights, highlighting the framework's robustness and practicality.
Quadrotors can now navigate to specific objects in images by intelligently selecting viewpoints, significantly enhancing their operational capabilities in complex environments.
Instance-Specific Image-Goal Navigation (InstanceImageNav) requires a robot to navigate toward the exact object instance depicted in a query image. Extending this task to quadrotors is challenging due to continuous 3D control, limited field of view (FOV), and safety constraints, which make successful navigation highly dependent on selecting informative viewpoints. We propose a hierarchical navigation framework for quadrotor InstanceImageNav that separates high-level decision making from low-level motion execution. Instead of navigating directly to spatial locations, the system generates viewpoint-aware action nodes around frontier regions and potential target objects, enabling the robot to explore while maintaining informative viewpoints for detecting the target instance. A lightweight semantic memory maintains object-level and observation-level context, allowing semantic cues to propagate to candidate action nodes for decision making. A learning-based policy selects the most promising action node, and a trajectory planner generates dynamically feasible 3D flight paths for safe execution. Experiments in simulation demonstrate consistent improvements over strong baselines, and real-world quadrotor flights validate the practicality and robustness of the proposed framework.
