Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Analytic Dynamics, a feed-forward framework that enhances the inference of intrinsic object dynamics from monocular video by incorporating an intermediate physics-grounded representation. By leveraging privileged physical states from simulations, the approach effectively aligns visual representations with structured dynamics, enabling models to better capture relevant patterns for material classification and parameter regression. Experimental results show that this method significantly improves the efficiency and accuracy of dynamics inference compared to existing techniques that either rely on costly optimizations or direct mappings prone to shortcuts.
Bridging the gap between visual observations and intrinsic dynamics, Analytic Dynamics enables fast and accurate inference that traditional methods struggle to achieve.
Inferring object dynamics from visual observations is essential for intelligent agents to reason about and interact with the physical world, yet remains challenging due to the fundamental gap between visual evidence and intrinsic dynamics. Existing methods either rely on costly per-scene optimization, limiting efficiency and scalability, or directly map visual evidence to intrinsic dynamics without intermediate physical abstractions, making them prone to appearance and geometry shortcuts. To bridge this gap, we propose Analytic Dynamics, a feed-forward dynamics inference framework that introduces an intermediate physics-grounded dynamics representation between visual observations and intrinsic dynamics. Specifically, we leverage privileged physical states, including position, displacement, and deformation gradient fields, which are available in simulation, to learn a structured dynamics representation that is difficult to discover from visual observations alone. By aligning visual representations with this space, we equip visual models with a physics-grounded inductive bias, guiding them to capture dynamics-relevant patterns for material model classification and parameter regression. To facilitate this research, we develop a dynamics data generation pipeline and benchmark containing paired physical state trajectories, rendered videos, and ground-truth material models and parameters. Extensive experiments demonstrate that Analytic Dynamics achieves efficient, accurate, and generalizable dynamics inference from monocular videos.