Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
This paper introduces GeoState, a novel view-decoupled geometry representation for 3D world modeling that disentangles scene dynamics from camera pose variations by aggregating multi-view geometry foundation model (GFM) features into a scene-centric state. This approach enables an autoregressive world model to predict future scene states independently of camera motion, allowing for consistent decoding under arbitrary camera viewpoints and eliminating per-frame scale alignment. GeoState achieves state-of-the-art performance on Waymo, demonstrates geometrically consistent cross-view querying, and generalizes zero-shot to new datasets.
Predict future 3D scenes without needing to track camera pose, enabling consistent scale and cross-view understanding.
Recent 3D world models increasingly use features from geometry foundation models (GFMs) as predictive world states, benefiting from their rich geometric priors. However, the view dependence of these features entangles scene dynamics with camera-induced variation, making the resulting state evolution harder to predict. We propose GeoState, a view-decoupled geometry representation for predictive 3D world modeling that separates scene-state evolution from camera-dependent observation. Specifically, a scene tokenizer aggregates multi-view GFM features into a view-decoupled scene state, which a geometry decoder queries using camera rays. An autoregressive world model then predicts future scene states, while camera motion is modeled separately. The predicted states can therefore be decoded under either predicted or externally specified cameras, while retaining a single context-derived scale throughout the rollout without per-frame scale alignment. Experiments show that GeoState outperforms prior 3D world models on Waymo, supports geometrically consistent cross-view querying, and generalizes zero-shot to KITTI and nuScenes. Project page: https://hongchang-liu.github.io/GeoState-project-page/