Search papers, labs, and topics across Lattice.
This paper introduces a hierarchical fast-slow ReAct agent designed for zero-shot object-goal navigation, which allows a robot to effectively locate named object categories in unfamiliar environments. By integrating a coordinate-anchored memory system that retains information about previously visited areas and employing a deliberative layer for reasoning, the agent significantly improves navigation success rates. The proposed method achieves a success rate of 68.75% on the HM3D validation set, outperforming existing zero-shot navigation approaches and demonstrating the importance of memory in decision-making processes.
Retaining memory of past observations boosts zero-shot navigation success by over 3% compared to traditional argmax approaches.
Zero-shot object-goal navigation (ZSON) requires a robot to find a named object category in a building it has never entered. The prevailing approach scores frontiers with a vision--language \emph{value map}: every decision is another argmax over the map as it currently stands, and the evidence behind that score is discarded the moment it is taken. Systems that place a large vision--language model inside the perception--action loop typically query it on a fixed schedule from the current view alone; a room the robot walked through minutes earlier is never reconsidered, and a failed call has no defined fallback. We turn what the robot has already seen into the object of deliberation. Our hierarchical fast--slow agent leaves the value-map controller running at every step and writes a \emph{coordinate-anchored memory} as it moves: a semantic grid of room types and confirmed object instances, together with a bounded store of pose-tagged keyframes. A VLM screens each candidate detection before it is written. A deliberative layer reads this memory in a bounded reason--retrieve--act loop. It wakes on structural events the reactive layer computes, reasons first over text, and recalls a first-person view only for candidates that text alone cannot separate. Per-invocation and per-run caps bound its calls, a call-free first tier resolves the most frequent stall, and any failure returns control to the reactive controller. Our system reaches 68.75% SR on HM3D v1 \texttt{val} and 47.29% on MP3D \texttt{val}, the highest success rate among the zero-shot methods compared here. Choosing among far frontiers by argmax instead of deliberating costs 3.40 SR points in a paired comparison over all 2000 HM3D episodes (95\% CI [1.70, 5.05]); deliberating over every frontier does not recover them.
