Search papers, labs, and topics across Lattice.
MoMaStage is introduced, a vision-language framework for long-horizon mobile manipulation that uses a hierarchical skill library and skill-state graph to constrain task decomposition and skill composition, eliminating the need for explicit scene mapping. This structured grounding ensures logically consistent and topologically valid plans with respect to the agent's physical state, while a closed-loop execution mechanism monitors proprioceptive feedback and triggers graph-constrained semantic replanning when deviations are detected. Experiments in simulation and real-world environments demonstrate that MoMaStage outperforms state-of-the-art baselines in planning success, token overhead, and overall task success rates.
Achieve substantially higher success rates in long-horizon mobile manipulation by grounding a vision-language model within a skill-state graph, enabling logically consistent planning and closed-loop replanning.
Indoor mobile manipulation (MoMA) enables robots to translate natural language instructions into physical actions, yet long-horizon execution remains challenging due to cascading errors and limited generalization across diverse environments. Learning-based approaches often fail to maintain logical consistency over extended horizons, while methods relying on explicit scene representations impose rigid structural assumptions that reduce adaptability in dynamic settings. To address these limitations, we propose MoMaStage, a structured vision-language framework for long-horizon MoMA that eliminates the need for explicit scene mapping. MoMaStage grounds a Vision-Language Model (VLM) within a Hierarchical Skill Library and a topology-aware Skill-State Graph, constraining task decomposition and skill composition within a feasible transition space. This structured grounding ensures that generated plans remain logically consistent and topologically valid with respect to the agent's evolving physical state. To enhance robustness, MoMaStage incorporates a closed-loop execution mechanism that monitors proprioceptive feedback and triggers graph-constrained semantic replanning when deviations are detected, maintaining alignment between planned skills and physical outcomes. Extensive experiments in physics-rich simulations and real-world environments demonstrate that MoMaStage outperforms state-of-the-art baselines, achieving substantially higher planning success, reducing token overhead, and significantly improving overall task success rates in long-horizon mobile manipulation. Video demonstrations are available on the project website: https://chenxuli-cxli.github.io/MoMaStage/.
