Search papers, labs, and topics across Lattice.
The paper introduces MOPS-PRM, a sampling-based motion planner for high-DoF robots operating in cluttered environments, which integrates perception constraints for multi-object monitoring into the planning process. It leverages a scene graph representation to encode the environment and incorporates perception costs associated with observing multiple objects, guiding the sampling of robot configurations. Experiments demonstrate MOPS-PRM achieves significant improvements in object detection and tracking compared to existing perception-constrained baselines, while maintaining comparable planning times and path lengths.
High-DoF robots can now navigate complex environments while actively maintaining visual contact with multiple objects, thanks to a new motion planner that bakes perception directly into the planning process.
It will be increasingly common for robots to operate in cluttered human-centered environments such as homes, workplaces, and hospitals, where the robot is often tasked to maintain perception constraints, such as monitoring people or multiple objects, for safety and reliability while executing its task. However, existing perception-aware approaches typically focus on low-degree-of-freedom (DoF) systems or only consider a single object in the context of high-DoF robots. This motivates us to consider the problem of perception-aware motion planning for high-DoF robots that accounts for multi-object monitoring constraints. We employ a scene graph representation of the environment, offering a great potential for incorporating long-horizon task and motion planning thanks to its rich semantic and spatial information. However, it does not capture perception-constrained information, such as the viewpoints the user prefers. To address these challenges, we propose MOPS-PRM, a roadmap-based motion planner, that integrates the perception cost of observing multiple objects or humans directly into motion planning for high-DoF robots. The perception cost is embedded to each object as part of a scene graph, and used to selectively sample configurations for roadmap construction, implicitly enforcing the perception constraints. Our method is extensively validated in both simulated and real-world experiments, achieving more than ~36% improvement in the average number of detected objects and ~17% better track rate against other perception-constrained baselines, with comparable planning times and path lengths.
