Search papers, labs, and topics across Lattice.
This paper introduces RAVEN, a novel memory system designed for long-horizon robotic question answering and navigation, which effectively integrates visual embeddings with pose and time in a vector database. By grounding retrieval in a spatial map and operating directly on visual embeddings, RAVEN achieves superior performance in semantic, spatial, and temporal retrieval while significantly reducing retrieval costs. Experimental results demonstrate that RAVEN outperforms traditional caption-based memory systems and matches state-of-the-art vision-language models in long-horizon tasks, showcasing its practical application in real-world robotic navigation scenarios.
RAVEN achieves 10脳 lower retrieval costs while matching the performance of leading vision-language models in long-horizon navigation tasks.
Long-term robot deployment requires a compact and scalable memory that preserves fine-grained visual semantics, grounds observations in space and time, and enables efficient storage and retrieval. In this paper, we propose RAVEN, an agentic memory system for long-horizon robotic question answering and navigation. RAVEN stores visual embeddings with pose and time in a vector database, and grounds retrieval in a spatial map to answer queries and navigate to goals. By operating directly on visual embeddings, RAVEN avoids lossy image-to-text captioning and enables accurate semantic, spatial, and temporal retrieval at scale. Across several simulated and real-world video question-answering benchmarks, RAVEN consistently surpasses caption-based memory systems and matches frontier VLMs on long-horizon tasks at 10$\times$ lower retrieval cost. Finally, we instantiate RAVEN on a Unitree Go1 robot for the task of long-horizon navigation for natural language goal-reaching, and show successful deployment over several large indoor environments.
