Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
PlayTrain pairs large language models with a high-throughput execution pipeline to automatically synthesize, modify, and run JavaScript video game environments through a standard Gym interface. This eliminates the engineering bottlenecks of manual environment design, unlocking rapid procedural generation, custom game dynamics, and instant human-playability for inspection. Evaluating on clones and modifications of Atari and ProcGen, the framework trains pixel-based RL agents end-to-end at over 1 million decisions per second on a single GPU node.
Turning LLM-written JavaScript games directly into GPU-accelerated Gym environments bypasses manual RL simulation engineering while hitting over 1M decisions per second on a single node.
While many video-game environments (VGEs) have played crucial roles in advancing reinforcement learning (RL), developing novel VGEs or modifying existing ones to support new features, has been a laborious process requiring extensive hand-coding. Here we present PlayTrain, an RL framework that combines the abilities of large language models (LLMs) to robustly generate JavaScript (JS) games from a minimal human prompt, and an efficient pipeline that can run any JS game in a standard 'gym' environment. Not only are recent LLMs particularly good at writing JS code, but the JS format also allows users to easily play generated VGEs, while PlayTrain enables us to train RL agents on the exact same games. We demonstrate multiple use cases of PlayTrain, including cloning well-known Atari and ProcGen games in simple JS, where PlayTrain trains pixel-based agents end-to-end at over 1M agent-decisions per second on a single GPU node; and creating modified versions thereof (e.g., that support novel test sets, procedural generation logics, or game dynamics). Through PlayTrain, we reimagine RL VGE development: all we need is a single JS file, generated and modified through an LLM. We discuss promising future RL research directions that PlayTrain unlocks.