Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To address the optimization bottlenecks of planning in joint-embedding predictive architectures, the authors formulate Control-Geometry Straightening (CGS), an auxiliary loss that aligns pairwise action similarities with corresponding latent-state displacement vectors using local transitions. Theoretically, CGS balances terminal-cost curvature across planning horizons to unlock finite-budget convergence guarantees for common optimizers like MPPI, CEM, and gradient descent. Empirically, the approach achieves up to 20 and 12.6 percentage point success-rate improvements over LeWorldModel and its temporal-straightening variant across four visual control environments under compute-constrained sampling budgets.
Latent world models often fail at planning not because their dynamics predictions are inaccurate, but because distorted control geometry makes the latent optimization landscape hostile to sampling-based search.
Joint-embedding predictive architectures enable planning with latent world models, but accurate transition prediction alone does not ensure that the planning objective is easy to optimize. We introduce Control-Geometry Straightening (CGS), a single auxiliary loss that learns planner-friendly representations by directly straightening control geometry for sampling-efficient planning. CGS matches pairwise cosine similarities among actions to those among corresponding latent differences only using local transitions from pixel-action pairs. The loss can be applied across world-model architectures using end-to-end learned or pretrained representations. Under linear-dynamics, our theoretical analysis connects this objective to temporal straightening and more balanced terminal-cost curvature across the full planning horizon, yielding finite-budget guarantees for MPPI, local contraction results for CEM, and convergence bounds for gradient descent. Across four control environments and multiple planners, CGS improves planning with fewer sampled candidates and refinement steps, achieving success-rate gains up to 20 and 12.6 percentage points over LeWorldModel (LeWM) and its temporal-straightening variant (LeWM+TS), respectively, with sampling-based planners using 128 candidates per update. Probes, comparisons with DINO-WM architecture, and planner-side ablations clarify how latent motion organization, state dependence, and dynamical context shape planning behavior. Straightening control geometry thus makes good action sequences easier to find under limited planning budgets.