Search papers, labs, and topics across Lattice.
This paper introduces ExPhy, a novel benchmark designed to explicitly evaluate the learning of physical properties in multi-object trajectory forecasting, addressing a significant gap in existing benchmarks that typically focus solely on trajectory prediction. The benchmark consists of 24,000 simulated scenes with detailed object-level labels for mass, friction, and restitution, enabling a comprehensive assessment of both trajectory forecasting and physical property estimation. The authors also present PhyODE, a physics-guided model that significantly outperforms existing methods in long-horizon forecasting, achieving reductions in average distance error (ADE) and final distance error (FDE) by over 30% on challenging out-of-distribution tasks.
Accurate trajectory forecasting doesn't guarantee understanding of the underlying physical properties, as shown by ExPhy's insights into model performance.
Understanding object dynamics requires not only predicting future trajectories but also examining whether a model captures the physical properties that govern motion. However, existing benchmarks rarely expose object-level physical properties as explicit evaluation targets alongside trajectory forecasting. To address this gap, we introduce \emph{ExPhy}, a multi-object trajectory forecasting benchmark containing 24,000 simulated physical scenes with explicit object-level labels for mass, friction, and restitution. ExPhy provides observed and future trajectories together with an in-distribution (ID) split and two out-of-distribution (OOD) splits over physical parameters (OOD-Parameter) and initial states (OOD-Initial) for jointly evaluating trajectory forecasting and physical property estimation. We further instantiate \textsc{PhyODE}, a physics-guided model with an explicit property interface that estimates physical properties from observed trajectories and uses them for differentiable future rollout. On the long-horizon OOD-Initial setting, \textsc{PhyODE} reduces ADE and FDE by 33.1\% and 31.0\%, respectively, compared with the strongest baseline. Zero-shot evaluation on ComPhy further assesses cross-benchmark transfer. Property-level analyses reveal that accurate trajectory forecasting does not necessarily imply accurate recovery of the underlying physical properties. Code and data are available at https://github.com/Zest86/ExPhy.
