Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
JAXtari is a high-throughput reimplementation of the Arcade Learning Environment leveraging massive GPU parallelization, enabling PPO agents to complete 100M environment steps in under an hour on a single A100. It addresses ALE's limitations by providing object-centric observations and a flexible modification system, facilitating research into causal modeling and neuro-symbolic methods. This allows for rapid agent development and adaptation, with some experiments completing in minutes.
Train PPO agents on 100M Atari steps in under an hour with object-centric observations and easy environment modification.
The Arcade Learning Environment (ALE) has been a cornerstone of Deep Reinforcement Learning research, providing a standardized benchmark for evaluating general agents. However, its lack of native support for object-extraction and environment modification restricts research into evaluating whether agents learn robust causal models or rely on brittle visual heuristics. Furthermore, the ALE's dependence on CPU-based emulation creates a significant bottleneck in modern GPU-accelerated training pipelines, limiting both experimental scale and iteration frequency. In this work, we introduce JAXtari, an open-source, high-performance reimplementation of Atari 2600 environments. By leveraging massive GPU parallelization, JAXtari allows PPO agents to finish training on 100M environment steps on a single A100-GPU in under an hour. Beyond speed, it provides object-centric observations and a flexible modification system, allowing researchers to, e.g. develop neuro-symbolic methods or discover novel shortcuts and subsequently train and adapt their agents rapidly, sometimes in only minutes.