Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
LiteNWM addresses the computational cost of generative navigation world models by introducing a latent approach that shares visual encodings and jointly predicts action-conditioned future representations across multiple horizons. This enables efficient candidate evaluation via a learned scorer, leading to significant reductions in trajectory error and substantial end-to-end speedups in offline benchmarks. Real-robot deployments demonstrate a dramatic improvement in navigation success rates in unseen environments, validating its utility for future-aware planning.
A latent world model slashes navigation planning costs by 128x while boosting real-robot success rates from 43% to 83% in unseen environments.
Direct visual navigation policies generate trajectories efficiently but do not explicitly evaluate their future consequences. Generative navigation world models provide this foresight through visual rollouts, which are costly when evaluating multiple candidates. We present LiteNWM, a latent navigation world model that shares visual encoding across candidates and jointly predicts their action-conditioned future representations at multiple horizons, while a learned scorer uses these predictions to select trajectories. In offline evaluations on RECON, SCAND, and SACSoN, LiteNWM reduces macro-averaged trajectory error by 17.56% relative to NoMaD+NWM-XL and achieves a 128.00-fold end-to-end speedup on an RTX 5090. The same evaluator transfers from NoMaD to MBRA without proposer-specific retraining, reducing MBRA's macro-averaged trajectory error by 16.2%. In real-robot experiments in unseen indoor and outdoor environments, LiteNWM improves navigation success from 43.3% to 83.3% relative to NoMaD. These results demonstrate that LiteNWM can be deployed for future-aware planning and closed-loop navigation on a physical robot.