Search papers, labs, and topics across Lattice.
Solaris introduces a novel interface world model that generates interactive user interfaces in real-time based on user actions, rather than relying on pre-coded specifications. By treating mouse interactions as conditioning signals, it synthesizes visual states autoregressively while maintaining coherence through few-step distillation and self-output training. This approach allows for dynamic, open-ended interactions, marking a significant shift towards adaptive software interfaces that evolve with user intent.
Solaris redefines user interfaces by generating them on-the-fly, enabling a level of adaptability and interactivity previously unattainable with traditional coding methods.
Digital interfaces are traditionally implemented through intermediate representations such as code, requiring their appearance and behavior to be specified in advance. We introduce Solaris, an interface world model that instead generates an interactive UI directly, frame by frame, in response to user actions. Solaris treats mouse interactions as conditioning signals and autoregressively synthesizes the resulting visual state at interactive speeds. To enable real-time generation while maintaining visual coherence over extended interactions, we combine autoregressive frame generation with few-step distillation and training on the model's own outputs. A language model complements the visual world model by interpreting user intent and specifying how interactions should affect the generated environment, separating high-level reasoning from visual rendering. By generating both the appearance and behavior of an interface dynamically, Solaris enables open-ended interactions that need not be explicitly programmed in advance. We view interface world models as a step toward a new paradigm for software, where interfaces are generated and adapted continuously around user intent rather than implemented as fixed collections of predefined states and
