Search papers, labs, and topics across Lattice.
This paper introduces T3S, a multi-task reinforcement learning framework that enhances learning efficiency by employing task-specific feature selectors and a dynamic task scheduler. By utilizing hypernetworks to create soft masks for task-specific features and selecting tasks based on progress metrics, T3S effectively mitigates inter-task interference. Experimental results demonstrate that T3S significantly outperforms existing state-of-the-art MTRL algorithms across various robotics manipulation tasks, highlighting its practical applicability in complex environments.
T3S achieves unprecedented efficiency in multi-task reinforcement learning by tailoring features and task selection, outperforming existing methods in robotics tasks.
Multi-task reinforcement learning (MTRL) is a technique to train multiple tasks simultaneously, where previous works usually train a single model to solve different tasks by sharing parameters across various tasks. However, these methods are faced with inter-task interference since what parameters should be shared across tasks is not addressed, dramatically reducing learning efficiency. To solve these problems, we propose a novel MTRL framework called Task-Specific feature Selector and Scheduler (T3S), which consists of two components: a feature selector and a task scheduler. Specifically, the feature selectors employ hypernetworks to construct task-specific soft masks, which can be applied by globally shared representation to construct task-specific features. The task scheduler selects tasks for learning through two metrics, where the selection probability is inversely proportional to task progress (e.g., success rate) and task learning speed. Experimental results show that T3S consistently outperforms the state-of-the-art MTRL algorithms on various robotics manipulation tasks.
