Search papers, labs, and topics across Lattice.
This paper introduces a meta-knowledge reutilization framework that decouples task inference from embodiment-specific control in meta-reinforcement learning, addressing inefficiencies in existing methods. By employing a Bayesian non-parametric prior and a semantic-magnitude interface, the framework effectively organizes latent task modes and translates them into temporally aligned subgoals for diverse agents. Experimental results demonstrate a significant reduction in final-step tracking error by up to 99.79% and improved sample efficiency, achieving comparable performance with only 23.8% of the interaction data required by state-of-the-art baselines.
Task knowledge can be efficiently reused across heterogeneous agents, slashing tracking errors by up to 99.79% while using significantly less data.
Meta-reinforcement learning enables fast adaptation by extracting shared structure from related tasks, but existing end-to-end methods often couple task inference with embodiment-specific control. This coupling can obscure non-parametric task semantics, reduce sample efficiency, and limit cross-agent reuse. We propose a meta-knowledge reutilization framework that learns task-level knowledge on a dynamics-simplified agent and transfers it to heterogeneous agents. The framework uses a Bayesian non-parametric prior to organize latent task modes and a high-level policy to generate task-level magnitude guidance. To bridge reusable task knowledge with different embodiments, we introduce a semantic-magnitude interface and a lightweight temporal adaptor, which convert frozen meta-knowledge into temporally aligned subgoals for embodiment-specific low-level controllers. Experiments on multiple locomotion agents show that our framework reduces final-step tracking error by 94.75% -- 99.79% compared with recent state-of-the-art baselines and achieves comparable deployment performance with about 23.8% of their interaction data.
Tsinghua AI