Search papers, labs, and topics across Lattice.
This paper introduces Temporal Forcing, a novel 4D representation alignment method that enhances vision-language-action (VLA) models by incorporating temporal information to address challenges in long-horizon manipulation and observation aliasing. By integrating a history pathway that summarizes observation history into temporally aware latent representations and aligning these with features from a pretrained 4D foundation model, the approach significantly improves the model's understanding of dynamic environments. The results show a notable performance increase, achieving 98.8% on the LIBERO benchmark and improving task success rates from 20.0% to 43.3% in a physical hidden-placement task.
Temporal Forcing boosts VLA model performance by over 2 points and doubles success rates in complex manipulation tasks by integrating temporal awareness into representation learning.
Recent vision-language-action (VLA) methods improve manipulation performance by aligning their representations with 3D scene geometry. However, these methods often struggle with long-horizon manipulation and observation aliasing between visually similar states due to a lack of temporal information: the 3D scene geometry captures only the current state, rather than how it has evolved over time. To resolve this, we present Temporal Forcing, a 4D representation alignment method for VLA models. Specifically, we first introduce a history pathway that enables a vanilla VLA model to summarize observation history into temporally aware latent representations. Then, the latent representations are aligned with the geometric features extracted by a pretrained 4D foundation model, which captures the evolving 3D world through temporally consistent geometric representations, enabling a deeper understanding of dynamic environments. Temporal Forcing reaches 98.8% on LIBERO, outperforming its base model by 2.2 points. On a physical hidden-placement task, it raises full-task success from 20.0% to 43.3%. Code will be publicly available.
