Search papers, labs, and topics across Lattice.
This paper introduces a novel latent world model for image-goal navigation that incorporates a Monotone Cost Ranking (MCR) loss to enhance planning cost accuracy, addressing the shortcomings of traditional sampling-based planners like the Cross-Entropy Method (CEM). By utilizing a frozen DINO-family encoder and training with complementary objectives, the model achieves significant improvements in navigation performance, reducing orientation error by 2.7 times compared to existing baselines. The approach not only excels in simulated environments but also demonstrates robust zero-shot deployment on physical robots in diverse settings.
Monotone Cost Ranking drastically improves planning accuracy, enabling state-of-the-art performance in image-goal navigation tasks.
Image-goal navigation with latent world models requires not only accurate future prediction, but also a planning cost that reliably ranks candidate action sequences. We define the cost as the cosine distance between the predicted future embedding and the goal embedding, and show that poor cost ordering can mislead sampling-based planners such as Cross-Entropy Method (CEM). To address this, we propose a latent world model built on a frozen DINO-family encoder and train it with two complementary objectives. An autoregressive rollout loss reduces the gap between training and multi-step planning rollouts, while a Monotone Cost Ranking (MCR) loss directly encourages increasingly perturbed action sequences to receive higher planning costs. We also study InfoNCE-based action-contrastive training and find that temporal permutation negatives distort the latent geometry and degrade planning performance. On the GNM navigation dataset, our method outperforms Navigation World Models (NWM), DINO-WM, OmniVLA, and NoMaD, achieving state-of-the-art image-goal navigation performance while reducing orientation error by $2.7\times$ over the same-encoder DINO WM baseline. We also deploy the model zero-shot on a physical robot, where it follows goal-directed paths in unseen indoor and outdoor environments.
