Search papers, labs, and topics across Lattice.
The Geometric Action Model (GAM) integrates a pretrained geometric foundation model (GFM) to enhance robot policy learning by directly incorporating 3D geometric reasoning into language-conditioned manipulation tasks. By splitting the GFM and utilizing shallow layers for observation encoding and a causal future predictor for action forecasting, GAM achieves superior performance in both simulation and real-robot benchmarks. The results demonstrate that GAM outperforms existing foundation-model-scale baselines in terms of accuracy, robustness, speed, and efficiency, highlighting the importance of 3D geometry in robotic manipulation.
GAM revolutionizes robot policy learning by seamlessly integrating 3D geometric reasoning, outperforming traditional models in accuracy and efficiency.
Generalist robot policies must follow user instructions while reasoning about how objects, cameras, and robot actions interact in the 3D physical world. Recent vision-language-action models (VLAs) and video world-action models (WAMs) inherit strong semantic or temporal priors from large-scale foundation models, but they still operate primarily on 2D image frames or 2D-derived latent spaces, leaving implicit the 3D geometry required for contact-rich manipulation. We propose the Geometric Action Model (GAM), a language-conditioned manipulation policy that directly repurposes a pretrained geometric foundation model (GFM) as a shared substrate for perception, temporal prediction, and action decoding. GAM splits the GFM at an intermediate layer: the shallow layers serve as an observation encoder, and a causal future predictor inserted at the split layer forecasts future latent tokens conditioned on language, proprioception, and action history. The predicted future tokens are then routed through the remaining GFM blocks for feature propagation and decoding, allowing a single backbone to produce both future geometry and actions. This design equips the GFM with language-conditioned temporal world modeling through minimal architectural modification while preserving its rich geometric priors. Across a broad suite of simulation and real-robot manipulation benchmarks, GAM is more accurate, more robust, faster, and lighter than current foundation-model-scale baselines.
