Search papers, labs, and topics across Lattice.
Magpie introduces a real-time generative world-rendering system specifically designed for interactive games, addressing the limitations of traditional graphics pipelines that hinder rapid game development. By decoupling gameplay execution from visual generation, it allows designers to focus on defining scenes and rules while a separate Render Server generates visuals based on the game engine's output. This approach not only enhances the efficiency of asset production but also ensures stable gameplay mechanics and reproducibility, significantly shortening the development cycle for game prototypes.
Magpie revolutionizes game development by enabling real-time visual rendering without compromising gameplay design or requiring complete asset production.
Modern game development relies heavily on conventional graphics pipelines. High-quality visual content requires modeling, material authoring, animation, lighting, effects, and runtime optimization, making asset production expensive and extending the development cycle of game prototypes. Recently, video foundation models are beginning to change film and video production, but games differ from linear media, they require not only continuous and realistic imagery, but also stable and reproducible gameplay rules, object states, and interaction outcomes. We present Magpie, a real-time generative world-rendering system for interactive games. Magpie separates gameplay execution from visual generation. Designers define scenes and rules in a game engine. At runtime, the Game Engine resolves player actions and maintains world state, while an independent Render Server generates visual output from white-box frames produced by the engine. Magpie provides a system-level implementation path for applying generative models to real-time game rendering. It preserves gameplay designability and reproducibility, and reduces the dependence of early game prototypes on complete visual assets.
