Search papers, labs, and topics across Lattice.
The paper introduces IRIS, a new benchmark for unsupervised physical parameter estimation and governing-equation identification from monocular video, addressing the lack of standardized real-world datasets in this area. IRIS comprises 220 real-world 4K videos of single- and multi-body dynamic systems with ground-truth parameters and governing equations. The authors define a standardized evaluation protocol and evaluate several baselines, including a physics loss formulation and various equation-identification strategies, to establish reference performance and highlight areas for improvement.
Unsupervised learning of physical dynamics from video gets a much-needed dose of reality with IRIS, a benchmark dataset of 220 real-world videos, complete with ground truth and a standardized evaluation protocol.
Unsupervised physical parameter estimation from video lacks a common benchmark: existing methods evaluate on non-overlapping synthetic data, the sole real-world dataset is restricted to single-body systems, and no established protocol addresses governing-equation identification. This work introduces IRIS, a high-fidelity benchmark comprising 220 real-world videos captured at 4K resolution and 60\,fps, spanning both single- and multi-body dynamics with independently measured ground-truth parameters and uncertainty estimates. Each dynamical system is recorded under controlled laboratory conditions and paired with its governing equations, enabling principled evaluation. A standardized evaluation protocol is defined encompassing parameter accuracy, identifiability, extrapolation, robustness, and governing-equation selection. Multiple baselines are evaluated, including a multi-step physics loss formulation and four complementary equation-identification strategies (VLM temporal reasoning, describe-then-classify prompting, CNN-based classification, and path-based labelling), establishing reference performance across all IRIS scenarios and exposing systematic failure modes that motivate future research. The dataset, annotations, evaluation toolkit, and all baseline implementations are publicly released.
