Search papers, labs, and topics across Lattice.
This paper introduces ObsGraph, a hierarchical observation-centric scene graph designed to enhance embodied reasoning and exploration in robots navigating complex environments. By organizing visual information into room-view-object layers, ObsGraph facilitates efficient retrieval and exploration strategies that adapt based on the agent's current knowledge and evidence gaps. Experimental results show that this structured representation significantly improves both task success rates and efficiency in various benchmarks, underscoring the importance of targeted information gathering in robotic exploration.
Robots equipped with ObsGraph can achieve higher success rates in complex environments by dynamically adapting their exploration strategies based on structured scene representations.
Embodied reasoning and exploration are increasingly considered crucial abilities for robots operating in complex and unfamiliar environments. To accomplish tasks in such settings, an agent must identify and acquire the information necessary for the task through exploration. We propose ObsGraph, an observation-centric hierarchical scene graph that unifies scene representation, retrieval, and exploration. It retains visual evidence and organizes it into room-view-object layers: rooms provide coarse semantic anchors, views preserve contextual object covisibility, and objects store fine-grained details. On top of this representation, we perform coarse-to-fine hierarchical retrieval under a bounded budget, and crucially use retrieval outcomes to structure the exploration candidate space--activating room-level exploration, view refinement, or frontier exploration--thereby tightly coupling representation, retrieval, and adaptive multi-scale exploration. Experiments across embodied reasoning and exploration benchmarks demonstrate improved success and efficiency, highlighting the benefits of structured scene representation and more targeted information gathering driven by identified evidence gaps.
