Search papers, labs, and topics across Lattice.
This paper introduces the Reinformed Dreamer, an advanced model-based reinforcement learning algorithm that utilizes latent guidance to enhance representation learning. By addressing limitations in the privileged information representations of the existing Informed Dreamer, the authors demonstrate that their approach leads to significant improvements in performance across various benchmarks. The results indicate that incorporating additional supervisory signals can yield more effective learning in both partially and fully observable environments.
Latent guidance in the Reinformed Dreamer leads to more robust representation learning, outperforming previous methods in diverse benchmarks.
Much like humans benefit from guidance while learning, reinforcement learning algorithms may benefit from additional supervision beyond rewards. Leveraging additional information during training to learn better representations and behaviors has been the focus of asymmetric reinforcement learning. This learning paradigm has proven effective under partial observability when additional state information is available, but also under full observability when more refined state information is available. Focusing on model-based reinforcement learning, we study the effect of asymmetric learning on observation representations and on privileged information representations. First, we identify a limitation in the privileged information representations learned by an asymmetric model-based algorithm known as the Informed Dreamer. Then, we propose a novel asymmetric representation learning objective using latent guidance, resulting in a new algorithm called the Reinformed Dreamer. Experiments across several benchmarks show a more consistent improvement over Dreamer than previous asymmetric approaches.
Mila