Search papers, labs, and topics across Lattice.
This paper introduces S2-HWM, a Sparse Event-Structured Hierarchical World Model designed to enhance long-horizon surgical robot manipulation by addressing the challenges of sparse rewards and irregular task progress. By learning sparse event evidence from primitive latent trajectories, S2-HWM effectively coordinates an event-level manager and a primitive-step worker, enabling the model to predict variable-duration task segments and their associated rewards. The approach significantly improves performance, achieving a 98.7% success rate on the SurRoL-based PegTransfer task, surpassing the baseline GAS DreamerV3 by 22.7 percentage points.
S2-HWM achieves a remarkable 98.7% success rate in surgical robot manipulation by effectively learning to manage sparse rewards and irregular task progress.
Long-horizon surgical robot manipulation is challenging because task rewards are sparse, while meaningful interaction changes occur at irregular intervals. Existing world-model agents typically imagine at primitive-step resolution, leaving variable-duration task progress implicit. Manually specified stages can provide intermediate structure, but their task specific boundaries are difficult to align with state-dependent interaction transitions. We propose S2-HWM, a Sparse Event-Structured Hierarchical World Model that learns sparse event evidence from primitive latent trajectories to coordinate an event-level manager and a primitive-step worker. The event evidence schedules manager goal updates, and each selected latent goal conditions the worker's primitive actions until the next update. The learned event evidence also forms variable-duration segments for an Event Transition Model (ETM), which predicts the next?boundary stochastic state, segment duration, and accumulated segment reward. Chaining these event-level predictions provides a variable-duration continuation beyond the primitive imagination horizon for manager learning, while the worker retains primitive-step actor-critic learning. On a SurRoL-based PegTransfer task, S2-HWM achieves a success rate of 98.7%, outperforming the flat GAS DreamerV3 baseline by 22.7 percentage points.
