Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces DSG, a dynamic framework for constructing 3D scene graphs that adapts to changes in indoor environments caused by human activities and agent interactions. By employing a semantic-aware 3D Gaussian representation and a dual-view rendering approach for object change detection, DSG updates scene graph nodes effectively while enhancing spatial relationship reasoning through multi-granularity visual context. Experimental results on the DynTHOR benchmark and other datasets show that DSG significantly outperforms existing methods in both object node construction and spatial relationship accuracy, addressing a critical challenge in dynamic scene understanding for embodied agents.
DSG outperforms existing methods in dynamic scene graph construction, achieving superior accuracy in identifying interobject relationships in ever-changing indoor environments.
In indoor environments, object positions frequently change due to human activities or embodied-agent interactions, causing previously constructed scene graphs to become inconsistent with the current scene. To address this issue, we propose DSG, a dynamic 3D scene graph construction framework that detects object changes and performs spatial relationship reasoning. First, we construct a semantic-aware 3D Gaussian scene representation and develop a dual-view rendering-based object change detection method to enable reliable scene graph node updates. Second, we propose a spatial relationship reasoning method that incorporates multi-granularity visual context, enabling a large language model to identify a richer set of interobject spatial relationships. Furthermore, we introduce DynTHOR, a dynamic indoor scene graph benchmark built on the AI2-THOR simulation platform for evaluating scene graph construction in dynamic environments. Extensive experiments on Dyn-THOR, 3RScan, and real-world scenes demonstrate that DSG consistently outperforms existing methods in both object node construction and spatial relationship reasoning, significantly improving the accuracy of dynamic scene graph construction.