Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper identifies a critical failure mode in Joint Embedding Predictive Architectures (JEPAs) known as Objective Interference Collapse (OIC), which occurs when grounding against distinct external signals leads to the collapse of subordinate representational subspaces. To address this, the authors propose Dual-Channel Grounded World Modeling (DCGWM), which utilizes a partitioned latent space with inward-only gradient flow to prevent OIC by isolating physical and social-behavioral dynamics. The architecture includes a Physical Grounding Channel and a Social-Behavioral Grounding Channel, ensuring that updates in one channel do not interfere with the other, thus maintaining the integrity of both representations.
Joint learning in world models can lead to catastrophic interference, but a new dual-channel architecture promises to preserve representational integrity by isolating physical and social dynamics.
Joint Embedding Predictive Architectures (JEPAs) are a leading approach to world model representation learning. We identify a failure mode in JEPA-based world models grounded against two qualitatively distinct external signals: physical dynamics (sparse, high-magnitude, constraint-satisfying gradient corrections) and social-behavioral dynamics (diffuse, distribution-matching corrections). We term this Objective Interference Collapse (OIC): we argue that joint learning in a shared latent space causes the dominant channel to systematically collapse the subordinate channel's representational subspace, in a manner not resolvable by loss weighting alone. We propose Dual-Channel Grounded World Modeling (DCGWM), designed to structurally prevent OIC through a partitioned latent space (physical subspace Z_p, behavioral subspace Z_b) with inward-only gradient flow. A Physical Grounding Channel updates only Z_p via VICReg-style alignment to physical measurements; a Social-Behavioral Grounding Channel updates only Z_b via alignment to trajectories from an emergent multi-agent simulation. An Inter-Channel Interface Module couples the subspaces at the task level without cross-subspace gradients. An Asymmetric Grounding Adherence Loss penalizes rollout drift with a hard hinge for physical violations and a soft KL for behavioral divergence. A Generative Rendering Layer is architecturally isolated from the latent world model. We present three theoretical results: the partition removes the gradient-interference pathway implicated in OIC; each grounded subspace inherits anti-collapse guarantees from its alignment objective; and generative isolation is necessary under a stated assumption on the generative objective's geometry. This manuscript establishes the problem formulation and architecture; experimental validation is ongoing and will be reported in a future revision.