Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
Grounded in symplectic geometry and geometric quantization, LHFM models visual dynamics by representing images as exact Lagrangian graphs evolving under image-dependent Hamiltonian flows decomposed into transport and source fields. This physics-informed parameterization introduces a rigorous geometric inductive bias for continuous-time visual representations across both temporal forecasting and generative tasks. In deterministic video prediction, the recurrent formulation (LHFM-V) matches state-of-the-art accuracy at the lowest reported FLOP count among compared recurrent models, while the generative variant (LHFM-I) achieves lower FID than standard flow-matching baselines.
Symplectic mechanics cuts recurrent video prediction compute to record-low FLOPs while simultaneously outperforming standard flow matching in image generation.
We introduce LHFM, a geometric framework for learning image dynamics. Drawing on structures central to classical mechanics, symplectic geometry, and geometric quantization, LHFM represents each image as an exact Lagrangian graph and models its evolution through image-dependent Hamiltonian flows, which yield a transport--source parameterization of image velocities. Our primary application is deterministic video prediction: LHFM-V is a recurrent model that advances frames by integrating predicted transport and source fields, and achieves the lowest reported FLOP count among the compared recurrent models with similar prediction accuracy. The image variant, LHFM-I, shows that the same construction is compatible with flow matching: in a matched experiment, it attains a lower FID than the flow-matching baseline.