Search papers, labs, and topics across Lattice.
This paper introduces VOiLA, a framework that leverages learned diffusion models to create task-agnostic POMDP models for efficient online planning in uncertain environments. By distilling diffusion samplers into compact feedforward generators and integrating them with a GPU-optimized POMDP planner, VOiLA significantly reduces sampling costs by nearly three orders of magnitude. Experimental results demonstrate that VOiLA outperforms existing methods like Recurrent Soft Actor Critic while requiring less training data and successfully applies learned models in real-world robotic tasks.
VOiLA achieves a threefold reduction in sampling costs, making learned POMDP models viable for real-time robotic planning.
Planning under uncertainty is an essential capability for autonomous robots. The Partially Observable Markov Decision Process (POMDP) provides a powerful framework for such a capability. Although POMDP-based planning has advanced significantly, its application to real-world problems is often limited by the difficulty of obtaining faithful POMDP models. We present Vectorized Online planning wIth Learned diffusion model for POMDP Agents (VOiLA), a framework that learns task-agnostic POMDP models for online planning under uncertainty. VOiLA learns transition and observation samplers using conditional diffusion models and learns observation-likelihood models for particle-based belief updates. To enable efficient online planning, the diffusion samplers are distilled into compact feedforward generators and integrated with Vectorized Online POMDP Planner (VOPP), an online POMDP planner designed to leverage GPU parallelization. Experimental results indicate the distillation strategy reduces sampling cost by up to nearly three orders of magnitude, making learned generative POMDP models practical for online planning. Evaluation of VOiLA on three benchmark problems indicate that VOiLA achieves equal or better performance than Recurrent Soft Actor Critic while using less than 10% training data, and generalizes much better to unseen environment configurations. Physical robot evaluation indicates VOiLA uses the models learned using only simulated data and generates a policy that successfully accomplish the task in 10 of 10 runs.
