Search papers, labs, and topics across Lattice.
The paper introduces contextual latent world models for offline meta-RL, which jointly train a context encoder and a latent world model conditioned on the inferred task representation. This approach enforces task-conditioned temporal consistency, leading to task representations that capture task-dependent dynamics. The method demonstrates improved generalization to unseen tasks on MuJoCo, Contextual-DeepMind Control, and Meta-World benchmarks compared to existing offline meta-RL techniques.
Forget task discrimination, CLWMs learn *dynamics* for offline meta-RL by conditioning latent world models on inferred task representations.
Offline meta-reinforcement learning seeks to learn policies that generalize across related tasks from fixed datasets. Context-based methods infer a task representation from transition histories, but learning effective task representations without supervision remains a challenge. In parallel, latent world models have demonstrated strong self-supervised representation learning through temporal consistency. We introduce contextual latent world models, which condition latent world models on inferred task representations and train them jointly with the context encoder. This enforces task-conditioned temporal consistency, yielding task representations that capture task-dependent dynamics rather than merely discriminating between tasks. Our method learns more expressive task representations and significantly improves generalization to unseen tasks across MuJoCo, Contextual-DeepMind Control, and Meta-World benchmarks.
