Search papers, labs, and topics across Lattice.
This paper introduces BeliefDiffusion, a novel framework that integrates generative modeling with Model Predictive Control (MPC) to enhance navigation in partially observable environments. By leveraging diffusion models to characterize multimodal belief distributions, BeliefDiffusion enables agents to effectively plan navigation strategies based on imagined plausible configurations derived from limited sensory information. Experimental results show that BeliefDiffusion outperforms existing model-free reinforcement learning baselines and other generative methods, achieving higher navigation success rates and improved path efficiency.
Explicitly incorporating multimodal belief representations into planning leads to significantly more robust navigation in uncertain environments.
Navigation in partially observable environments presents a significant challenge for autonomous agents, requiring effective decision-making with limited sensory information in unknown environments. Belief-based methods, particularly those using neural networks to approximate the belief space, often fail to capture the inherent multimodality of belief spaces, especially in high-dimensional cases with perceptual aliasing. While generative models present a compelling alternative, they typically require substantial data or expert demonstrations and lack explicit mechanisms for long-term planning. In this paper, we introduce BeliefDiffusion, a novel framework that combines the benefits of both generation and planning. BeliefDiffusion leverages diffusion models to explicitly characterize multimodal belief distributions and utilizes Model Predictive Control (MPC) to simultaneously plan ahead. It consists of two steps: (1) Imagining plausible environment configurations based on observation history and (2) Planning efficient navigation strategies across an aggregated configurations. Through extensive experiments in synthetic map environments, we demonstrate that BeliefDiffusion significantly outperforms both model-free reinforcement learning baselines and other generative approaches in navigation success rate and path efficiency. Our results validate that explicitly incorporating multimodal belief representations into planning enables more robust navigation in partially observable settings.
