Search papers, labs, and topics across Lattice.
This paper introduces Hierarchical Robotic Control (HiRoC), a novel framework that separates high-level task planning from low-level action execution in robotic manipulation. By decomposing complex tasks into executable subgoals and enhancing action generation through reinforcement learning, HiRoC addresses the limitations of flat policies and improves long-horizon manipulation. Extensive experiments show that HiRoC outperforms existing methods, validating the effectiveness of hierarchical post-training in robotic control tasks.
Hierarchical post-training can significantly enhance robotic manipulation by enabling agents to better navigate complex tasks through effective subgoal decomposition.
Vision-language-action (VLA) models have demonstrated remarkable capabilities in robotic manipulation by leveraging pretrained vision-language models. However, existing post-training methods predominantly optimize VLA models as flat policies, making it difficult to explicitly model task progression and perform robust long-horizon manipulation. Although hierarchical approaches introduce task decomposition, they mainly rely on supervised learning from offline demonstrations and cannot effectively improve execution through online interaction. To address this limitation, we propose Hierarchical Robotic Control (HiRoC), a hierarchical post-training framework that decouples high-level task planning from low-level action execution. The planner decomposes complex tasks into executable subgoals to provide explicit semantic guidance, while the executor continuously improves subgoal-conditioned action generation through reinforcement learning. To enable effective collaboration between the two modules, we further align the executor with planner-generated subgoals before reinforcement learning, mitigating the distribution misalignment between planning and execution. Extensive experiments across diverse robotic manipulation benchmarks demonstrate that HiRoC consistently outperforms strong baselines. Comprehensive analyses further validate the effectiveness of hierarchical post-training and the contribution of each key component.
