Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a Generative World Simulation framework that couples a persistent, computable world engine (DAO) with an egocentric audiovisual generation model (JING) to enable sustained, interactive experiences. DAO maintains and evolves a shared world state, including character, object, and spatial relationships, while JING generates observer-specific audiovisual content based on this state and user interactions. The key result is a framework that supports continuous interaction loops, allowing actions to shape both the world's history and future experiences, creating persistent and evolving interactive worlds.
Persistent interactive worlds that evolve with history and agent actions are now possible through a novel coupling of a computable world engine and egocentric audiovisual generation.
We present a Generative World Simulation framework that couples persistent shared world state with continuous first-person audiovisual generation. The framework integrates DAO, a computable world engine, and JING, an Egocentric Interactive Experience Model, to support sustained interaction for humans and agents. DAO maintains the states of characters, objects, and spaces and their relationships, advancing the world according to interaction rules and world time while preserving the consequences of past actions. From this evolving state, DAO derives observer-specific conditions for JING, which combines these conditions with character, object, and scene references, observation history, and current actions to generate each observer's audiovisual experience. Users can explore environments, manipulate objects, and communicate with characters through viewpoint control and text instructions, with their actions shaping both the shared state and subsequent experiences. By connecting world-state evolution with experience generation in a continuous interaction loop, the framework offers an approach to building interactive worlds that retain their history, evolve through action, and persist beyond any individual observer.