Search papers, labs, and topics across Lattice.
This paper introduces FlowMaps, a latent flow matching model designed to predict multimodal distributions of dynamic object locations in 3D spaces, leveraging human interaction patterns to enhance robotic navigation. By capturing the implicit dependencies and temporal evolution of objects, FlowMaps enables robots to generalize their navigation strategies across diverse environments with similar object routines. The method significantly outperforms existing state-of-the-art techniques in a dynamic Object Navigation task, demonstrating its effectiveness in real-world applications involving changing household environments.
FlowMaps can revolutionize robotic navigation by accurately predicting object movements based on human interaction patterns, outperforming existing methods in real-world scenarios.
Joint spatial and temporal understanding of 3D scenes is a crucial requirement for robots deployed in everyday household environments. Such agents must not only comprehend and navigate spatial layouts, but also reason about how these spaces evolve over time. In particular, humans interact with objects daily, causing them to change position throughout the environment and making it difficult for robots to reliably associate current observations with previously seen objects. However, these interactions are not random: human habits and routines induce spatio-temporally consistent patterns in object locations, which robotic agents can potentially learn and then exploit for downstream tasks such as navigation. To this end, we introduce FlowMaps, a latent flow matching model for estimating multimodal distributions over the future locations of dynamic objects in a continuous 3D space. By learning the implicit dependencies among objects and their temporal evolution, FlowMaps predicts likely changes in object locations conditioned on past human interactions, while supporting generalization across previously unseen environments that share similar object routines. To demonstrate the utility of this method, we deploy FlowMaps in a downstream dynamic Object Navigation task in both simulated and real-world environments. Across more than 600 episodes, FlowMaps outperforms state-of-the-art approaches, showing that modeling object dynamics through continuous, multimodal spatio-temporal distributions improves robotic search and navigation in changing household environments. Code and additional material is available at https://fra-tsuna.github.io/flowmaps/.
Mila