Search papers, labs, and topics across Lattice.
This paper introduces PRACTICE, a novel framework that enables embodied agents to autonomously build and maintain a skill library from past interaction trajectories while keeping the task executor static. By employing a two-stage curriculum, the skill learner first acquires basic skill generation and library maintenance from oracle trajectories, and then enhances its capabilities by contrasting successful and failed trajectories to identify invalid actions and recovery strategies. Experimental results on EB-ALFRED and EB-Habitat show that PRACTICE consistently outperforms existing experience-based methods, demonstrating its effectiveness in skill adaptation and improvement across multiple frozen executors.
A skill learner that autonomously updates its library from experience can significantly enhance embodied agents' adaptability and performance.
Recent studies have shown that multimodal large language models (MLLMs) can serve as embodied agents, translating language instructions and visual observations into executable plans. However, building agents that can continually improve through interaction and rapidly adapt to their environments remains challenging. Summing up experience from past interaction trajectories provides a promising solution, but existing experience-based methods often rely on manually designed prompting workflows to extract and update skills. Such fixed procedures may struggle to learn updated skills from new and diverse experiences. We introduce PRACTICE, which trains a skill learner to discover and maintain a persistent skill library from past interaction trajectories while keeping the task executor frozen. Given the historical accumulated skills and incoming trajectories, the skill learner produces structured batch-edits that add, refine, merge, or remove skills, and then hierarchical consolidate all collected edits into a consistent updated skill library. We train the learner with a two-stage curriculum. First, it learns basic skill generation and library maintenance from oracle trajectories. Then, by contrasting successful and failed trajectories from heterogeneous executors on the same tasks, it learn to identify invalid action patterns and recovery strategies. Finally, we apply online skill-edit distillation to align the skill learner with a stronger teacher on its current edit distribution to further improves the policy. Experiments demonstrate that a compact skill learner delivers consistent performance improvements across successive library-update rounds for multiple frozen executors. On EB-ALFRED and EB-Habitat, PRACTICE further outperforms the strongest experience-based baselines. Project resources are publicly available at: https://baai-agents.github.io/PRACTICE
