Search papers, labs, and topics across Lattice.
This paper introduces Atomic Physical Transitions (APTs), which are minimal, temporally localized state changes that provide a causal understanding of physical events in videos, moving beyond traditional event labels. By constructing a mixed-source dataset of 27,303 instances across various physical transitions, the authors demonstrate that existing Video-Language Models (VLMs) struggle with transition-level physics, achieving only 14% zero-shot recall. The proposed APT-Tune method enhances VLMs' ability to learn causal transitions without sacrificing event-level performance, indicating a significant advancement in video understanding through human-aligned supervision.
Current VLMs miss crucial transition-level physics, but APT-Tune teaches them to learn causal transitions without forgetting event-level context.
Physical events are not understood by their names alone, but by the causal state changes that compose them. A clip-level label such as "bounce" can be correct while hiding the process that makes the event physically valid, from support loss and contact onset to rebound and settling. To make this hidden process explicit, we introduce Atomic Physical Transitions (APTs): minimal, temporally localized state changes that bind a visible cue to an active physical mechanism and before/after dynamical regimes. An APT chain represents a video as an ordered causal transition sequence rather than a single aggregate event label: event labels tell what happened; APT chains explain why it happened. To make APTs learnable by VLMs, we construct mixed-source APT data from human annotations and simulator ground truth, covering 14 transition types across contact, gravity, friction, and rotation/stability, with 27,303 timed instances over 1,246 trials. Using this data, we find that current VLMs miss transition-level physics, with zero-shot recall at most 14% and errors dominated by missed transitions. Direct fine-tuning on APT chains improves transition detection but causes event-level forgetting, indicating that the model learns a specialized answer format rather than a reusable physical representation. We therefore propose APT-Tune, a parameter-efficient recipe that teaches VLMs to use causal transitions without forgetting how to answer video questions. It combines image-pad-aware supervision, format-conditional co-training, and mechanism-conditioned domain-to-type decoding to make APT learning format-robust and physically grounded. With only 11 M LoRA parameters on Qwen3-VL-2B, APT-Tune substantially improves APT recall while also improving event-level video transfer. These results show that APTs are not a new answer format, but a human-aligned causal supervision signal for physical video understanding.
