Search papers, labs, and topics across Lattice.
This paper introduces Instant Episode Repetition (IER), a novel approach that enhances sample efficiency in reinforcement learning by immediately repeating successful action sequences during environment interaction. By actively reinforcing high-reward behaviors rather than passively reusing past experiences, IER significantly improves learning performance when integrated into state-of-the-art algorithms like SAC and TD3. Experimental evaluations on continuous-control benchmarks, including MuJoCo and real-world robotic tasks, show that IER outperforms traditional methods such as Experience Replay and Self-Imitation Learning.
Repeating successful actions in real-time can dramatically boost sample efficiency in reinforcement learning, outperforming conventional methods.
Repetition is a fundamental mechanism in human learning, where revisiting successful experiences strengthens memory, consolidates skills, and improves future performance. Motivated by this biological principle, we introduce Instant Episode Repetition (IER), a simple and novel mechanism that improves sample efficiency by immediately repeating action sequences from successful episodes during environment interaction. Unlike conventional approaches such as Experience Replay and Self-Imitation Learning (SIL), which passively reuse past experience during training updates, IER directly influences the data collection process. Upon identifying a high-reward episode, the agent repeats its action sequence for a fixed number of subsequent episodes, reinforcing valuable behaviors through renewed interaction with the environment. We integrate IER into state-of-the-art SAC and TD3 algorithms and evaluate its effectiveness on continuous-control benchmarks, including MuJoCo, the DeepMind Control Suite, and a real-world dynamic object translation task with a robotic manipulator. Experimental results demonstrate that this simple mechanism improves learning performance over standard and self-imitation-based baselines.
