Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study explores the integration of temporal hierarchy into LeWorldModel through the introduction of Hi-LeWM, which maintains a frozen low-level controller while implementing high-level planning over latent subgoals. The findings reveal that while hierarchy does not universally enhance performance, effective high-level subgoal generation is critical, particularly at longer horizons where misalignment with the low-level action space can hinder outcomes. By constraining the search around macro-actions derived from training trajectories, Hi-LeWM significantly outperforms the flat LeWM model, achieving improvements of +11.3 percentage points at medium-range and +14.7 percentage points at the longest horizon in the PushT task.
Hierarchical planning can unlock substantial performance gains in long-horizon control tasks, but only if high-level actions align with low-level execution capabilities.
We investigate whether temporal hierarchy can improve LeWorldModel on long-horizon goal-conditioned control. We introduce Hi-LeWM, an extension that freezes the pretrained low-level LeWM and adds high-level planning over latent subgoals. We evaluate Hi-LeWM on PushT and Cube across increasing goal offsets. Hierarchy does not automatically improve performance: at short horizons, the best configuration uses a one-step high-level horizon, while longer horizons reveal a mismatch between the learned high-level action space and the inference-time search distribution. Experiments with true future latent subgoals show that the frozen low-level controller can execute well-aligned intermediate targets, indicating that high-level subgoal generation is the main bottleneck. Unconstrained search can select latent macro-actions that appear favorable under the learned model but produce poor control targets. Constraining search around macro-actions encoded from training trajectories, with appropriate subgoal execution timing, recovers useful hierarchical regimes, improving over flat LeWM by +11.3 percentage points at medium-range horizons and +14.7 percentage points at the longest PushT horizon. Overall, temporal abstraction can benefit compact frozen LeWM, but only when high-level search remains compatible with the low-level controller