Search papers, labs, and topics across Lattice.
This paper introduces BRICKS-WM, a novel framework for modular assembly of structured world models in Model-based Reinforcement Learning (MBRL), addressing the limitations of monolithic latent dynamics that hinder reusability. By factorizing the latent state space into distinct Agent and Background modules, connected through a learned latent interface, the framework allows for independent manipulation of environment dynamics without retraining the entire model. Empirical results demonstrate that BRICKS-WM achieves competitive control performance with monolithic baselines while enabling the reuse of background dynamics across different agents, significantly improving efficiency in training and deployment.
Reusable background dynamics can now be shared across agents, slashing retraining costs while maintaining high performance in control tasks.
Model-based Reinforcement Learning (MBRL) has achieved remarkable success in continuous control by leveraging latent world models. However, prevailing approaches typically rely on monolithic latent dynamics, entangling environment dynamics into a coupled process. This coupling severely limits reusability: altering the agent necessitates retraining the entire world from scratch, even if the environment remains constant. To address this, we introduce BRICKS-WM (Building Reusability via Interface Composition Kinetics for Structured World Models), a framework for the modular assembly of structured world models. Driven by the insight that the physical world is composed of independent entities, we posit that global dynamics can be modeled as a composition of distinct dynamical modules interacting via latent interfaces. As a minimal instantiation, we factorize the latent state space into an actuated Agent module and an external Background module, bridged by a learned latent interface. Unlike prior object-centric methods that prioritize visual segmentation, BRICKS-WM enforces a functional separation in transition dynamics, ensuring that background dynamics remains agnostic to the agent's dynamics. Empirically, BRICKS-WM achieves control performance comparable to strong monolithic baselines when trained from scratch, and enables the reuse of frozen background dynamics across agents.
