Search papers, labs, and topics across Lattice.
This paper extends the Rao-Blackwellized online POMDP framework to enhance decision-making in high-dimensional partially observable environments by employing hybrid continuous-discrete belief representations. The approach analytically propagates uncertainty from marginalized state components during tree-based planning, significantly reducing the variance in value estimation typically seen in Monte Carlo methods. Experimental results in a robotic search-and-rescue task demonstrate that this new planner achieves higher cumulative rewards with fewer particles and planning simulations compared to traditional sampling-based methods, underscoring its efficiency in complex scenarios.
By leveraging structured high-dimensional representations, this method reduces sampling variance and boosts decision-making efficiency in robotic systems.
Online planning under uncertainty remains a fundamental challenge for robotic systems operating in partially observable environments with high-dimensional state spaces. While sampling-based POMDP solvers enable approximate decision-making in large or continuous domains, their performance degrades as belief dimensionality increases due to the high variance inherent in Monte Carlo-based estimation. In this work, we extend the Rao-Blackwellized online POMDP (RB-POMDP) framework to improve its generalizability in high-dimensional settings through hybrid continuous-discrete belief representations. By analytically propagating uncertainty associated with marginalized state components during tree-based planning, the proposed approach reduces sampling-induced variance in value estimation. We demonstrate the effectiveness of this framework in a robotic search-and-rescue task by integrating it with FastSLAM 2.0. Experimental results show that the proposed planner achieves higher cumulative rewards using significantly fewer particles and planning simulations than purely sampling-based methods under equivalent computational budgets. These results suggest that structured high-dimensional robotic problems admitting tractable sufficient statistics can be effectively leveraged within the RB-POMDP framework for computationally feasible online decision-making.
