Search papers, labs, and topics across Lattice.
This paper introduces MAGIC, a novel four-stage pipeline that generates navigable multi-scene game worlds from a single natural-language prompt, addressing the challenges of cross-scene consistency, in-scene navigability, and effective transition evaluation. By employing a transition-aware intermediate representation and a flood-fill validator, MAGIC ensures that portals are reachable and scenes are coherent, while a dedicated evaluation agent tests transitions in real-time. The system achieves impressive performance metrics, producing executable projects with 0.99 precision, 0.95 recall, and 0.96 F1 on a benchmark of 100 multi-scene cases, significantly outperforming existing methods.
MAGIC achieves near-perfect transition identification in multi-scene game worlds, transforming how developers can create interconnected gaming environments from simple prompts.
Multi-scene navigation (clearing an objective in one bounded space and then crossing a portal into the next) is a defining feature of contemporary 3D games, but authoring it is laborious: every portal must have consistent endpoints on both sides, each interior must remain navigable once it is furnished, and the resulting connectivity must be kept consistent across many files. Recent large language model (LLM) and multimodal LLM (MLLM) scene generators have made single-interior synthesis dramatically cheaper, yet they produce one scene at a time and cannot, by naive repetition, yield a connected multi-scene world. We identify three obstacles that single-scene methods leave unsolved: cross-scene consistency, in-scene navigability, and the evaluation of whether a transition actually works. We present MAGIC, a prompt-to-project system that addresses all three. MAGIC is a four-stage pipeline that turns a single natural-language prompt into a runnable multi-scene game project: it plans a shared transition-aware intermediate representation, specifies each scene while enforcing portal reachability with a flood-fill validator, generates the scenes together with their transition scripts, and combines them into one project. Because existing single-scene fidelity metrics never execute a transition, we further introduce a transition-focused evaluation agent that runs each transition in play. On a new benchmark of 100 multi-scene cases, MAGIC produces an executable project for every case and reaches 0.99 precision, 0.95 recall, and 0.96 F1 on end-to-end transition identification; stage by stage, it recovers more ground-truth portals and yields markedly more navigable layouts than an LLM baseline and Holodeck. Our code is available at https://github.com/sereneee1201/MAGIC/.