Search papers, labs, and topics across Lattice.
This paper introduces SAGE-Nav, a hierarchical framework that combines Large Language Models (LLMs) with dynamic scene graphs to enhance Object-Goal Navigation (ObjNav) for embodied agents. By decoupling global semantic planning from reactive control, SAGE-Nav enables LLMs to generate semantically grounded waypoints, which are then refined through a Hierarchical Scene Graph Encoder (HSGE) and a Goal-aware Alignment-Fusion Network (GAFN) that integrates real-time perception. The approach significantly improves navigation efficiency and zero-shot generalization in complex environments, outperforming existing methods while ensuring low control latency for robotic applications.
SAGE-Nav achieves state-of-the-art navigation efficiency and zero-shot generalization by seamlessly integrating LLM planning with dynamic scene graphs.
Object-Goal Navigation (ObjNav) requires embodied agents to autonomously locate specified targets using only egocentric visual observations. Existing monolithic methods struggle with long-horizon reasoning and generalize poorly to novel environments. To address these limitations, we propose SAGE-Nav, a novel hierarchical framework that integrates the reasoning capabilities of Large Language Models (LLMs) with dynamic scene graphs. Crucially, it decouples asynchronous global semantic planning from the high-frequency reactive control loop. The LLM serves as a global planner, decomposing abstract instructions into a sequence of semantically grounded waypoints. To translate these plans into dense multi-modal guidance, we design a Hierarchical Scene Graph Encoder (HSGE) that leverages relational graph convolutions to produce structure-aware embeddings preserving both semantic and spatial topology. Furthermore, we develop the Goal-aware Alignment-Fusion Network (GAFN) to dynamically fuse real-time perception with these structural priors. Using an adaptive gating mechanism with an explicit inductive bias, GAFN ensures robust visual-topological alignment for the low-level policy. Extensive evaluations in the i-THOR and RoboTHOR environments demonstrate that SAGE-Nav achieves state-of-the-art performance, delivering substantial gains in navigation efficiency and zero-shot generalization while maintaining the low control latency required for physical robotic deployment.
