Search papers, labs, and topics across Lattice.
This paper addresses the challenge of generalizing learned policies in Visual Reinforcement Learning (VRL) by introducing a novel self-supervised algorithm called Task-Relevant Representation Decoupling (T2RD). The method effectively separates observations into task-relevant and task-irrelevant features through a combination of representation consistency, cross-reconstruction, and dynamic prediction, leading to improved generalization capabilities. T2RD achieves state-of-the-art performance in both the DeepMind Control Suite and Robotic Manipulation tasks, demonstrating significant advancements in sample efficiency and generalization.
Agents trained with T2RD can generalize learned policies across environments without overfitting to irrelevant features, achieving state-of-the-art performance in VRL tasks.
Visual Reinforcement Learning (VRL) has achieved considerable success in solving control tasks. However, generalizing learned policies to new environments remains a major challenge, as agents often overfit to task-irrelevant features in the training environment. To solve this problem, we introduce the concept of decoupling observations into task-relevant and task-irrelevant representations. Building on this idea, we propose a self-supervised Task-Relevant Representation Decoupling (T2RD) algorithm for VRL. This algorithm consists of three components: task-relevant representation consistency, cross-reconstruction, and cross-dynamic prediction. The first two components achieve the decoupling of content and style features, but the resulting content representations are not necessarily task-relevant. To further refine task-relevant features from content representations, we design the third component that introduces dynamic prediction. T2RD achieves State-Of-The-Art (SOTA) generalization performance and sample efficiency in the DeepMind Control Suite and Robotic Manipulation tasks.
