Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces DashVMC, an action-conditioned world model trained on Geometry Dash gameplay to address the real-time constraints of live game environments. By learning dynamics from recorded data and fine-tuning a controller via PPO in frozen-model rollouts, the agent achieves significantly longer survival times than its behavioral cloning baseline. The system demonstrates effective control at 60 Hz, showcasing the viability of learned world models for real-time applications even with imperfect long-horizon predictions.
Learned world models can achieve real-time control in live games, outperforming behavioral cloning and maintaining high-frequency action loops.
World-model agents are usually evaluated in simulators that can wait for the policy; live games impose the opposite constraint, requiring capture, prediction, and action before the next frame. We present DashVMC, which learns a compact, action-conditioned world model from approximately two hours of recorded Geometry Dash gameplay. To test whether the learned dynamics are actionable, a controller is initialized by behavioural cloning (BC) and refined with Proximal Policy Optimization (PPO) entirely in frozen-model rollouts, without further interaction with the live game. Across three controller seeds, the refined policies survive longer than their BC initializations on all three official levels and a held-out community layout. At deployment, the baseline skips visual generation and sustains a 60-Hz capture-to-action loop on a consumer GPU. Action-conditioned continuations and rollout diagnostics show that the model remains useful for control despite imperfect long-horizon fidelity.