Search papers, labs, and topics across Lattice.
This paper introduces H-RePlan, a hierarchical replanning framework designed to enhance multi-device agent systems by enabling them to recover from failures more effectively. By separating device-local strategy recovery from global replanning, H-RePlan allows agents to adapt their execution strategies based on the specific context of failures, rather than relying on coarse-grained retries. Evaluation through the HeraBench benchmark reveals that H-RePlan significantly improves task completion and adherence rates while minimizing resource costs compared to existing methods.
H-RePlan achieves a remarkable increase in task completion rates by intelligently distinguishing between local and global recovery strategies in multi-device environments.
Real-world computer-use tasks often span multiple applications and devices, requiring agents to coordinate heterogeneous environments under dynamic runtime failures. Existing multi-device agent systems support task decomposition and cross-device assignment, but recovery remains largely coarse-grained: when execution fails, they typically retry the same strategy, reassign the subtask, or revise the global plan, without systematically modeling the device-local strategy space. This limits their ability to distinguish failures that can be repaired within the current device from those that require cross-device replanning. We propose \textbf{H-RePlan}, a hierarchical replanning framework for multi-device agents with unified API--CLI--GUI execution. H-RePlan equips each device with interchangeable execution strategies and separates device-local strategy recovery from orchestrator-level global replanning through a compact cross-layer failure abstraction. To evaluate this capability, we introduce \textbf{HeraBench}, a fault-injected benchmark that constructs cross-device workflows over Linux and Android devices and injects strategy- and device-level failures. Experiments show that H-RePlan substantially outperforms single-strategy and coarse-grained multi-device baselines, achieving higher completion, instruction adherence, and perfect-pass rates while reducing the token cost required for reliable end-to-end success. These results demonstrate that scope-aware hierarchical recovery is essential for robust multi-device agent execution.
Tsinghua AI