Search papers, labs, and topics across Lattice.
This paper introduces PhysMani, a novel framework that integrates a physics-principled 3D Gaussian world model with a future-aware action policy model to enhance dynamic object manipulation in unstructured environments. By employing an online optimization approach to learn a divergence-free Gaussian velocity field, PhysMani effectively predicts future dynamics, enabling more accurate manipulation of fast-moving targets. The framework outperforms existing models in both simulation and real-world robot experiments, as evidenced by its superior success rates across a newly established benchmark, PhysMani-Bench, featuring 16 dynamic manipulation tasks.
PhysMani achieves unprecedented success rates in dynamic object manipulation by accurately predicting future 3D scene dynamics through a physics-informed approach.
Manipulating fast and dynamically moving targets in unstructured 3D environments remains challenging for embodied AI. Existing visual-language-action models and world models struggle with accurate 3D geometry and physically meaningful forecasting. We propose PhysMani, a framework that couples a physics-principled 3D Gaussian world model with a future-aware action policy model. The world model learns a divergence-free Gaussian velocity field via online optimization for fast and physically grounded future dynamics prediction. The policy model integrates the predicted 3D scene future dynamics through a learnable token based cross-attention module. We introduce PhysMani-Bench, a dynamic manipulation benchmark with 16 tasks, and demonstrate a superior success rate over strong baselines in both simulation and real-world robot experiments.
