Search papers, labs, and topics across Lattice.
This paper introduces Latent Action Guided Flow Matching (LAFM), a novel framework that enhances flow matching policies for robotic manipulation by employing an adaptive library of learned prior distributions instead of a fixed isotropic source. By leveraging a latent action model to map observations to discrete motion primitives, LAFM effectively addresses the structural mismatch in action spaces, resulting in shorter and less entangled transport trajectories. Empirical results show that LAFM improves task success rates by 23.4% in real-world applications and by 10.4% on the LIBERO-90 benchmark, outperforming existing methods and smaller architectures.
LAFM boosts robotic manipulation success rates by over 23% by dynamically adapting to the complexities of action spaces.
Flow matching has recently become a new standard for behavior cloning in robotic manipulation. However, state-of-the-art flow matching policies suffer from a systematic structural mismatch: they rely on a globally fixed isotropic source distribution despite the strongly fragmented and heteroscedastic structure of robotic action spaces. This agnostic initialization forces the model to learn highly entangled vector fields, bottlenecking training efficiency and limiting overall policy performance. To address this limitation, we introduce Latent Action Guided Flow Matching (LAFM), a novel framework that replaces the monolithic Gaussian with an adaptive library of learned prior distributions. By grounding these distributions using a latent action model, LAFM maps current observations to discrete motion primitives, selecting a specialized base distribution that provides an informed, structurally aligned initialization for the denoising process. This dynamic adaptivity naturally accommodates heteroscedasticity in human demonstrations and makes transport trajectories shorter and less entangled. Empirically, LAFM substantially outperforms standard flow matching formulations, increasing task success rates by 23.4% in real-world robotic deployments and by 10.4% on the LIBERO-90 benchmark. Furthermore, we demonstrate that LAFM achieves state-of-the-art results, surpassing massively pre-trained vision-language-action models while utilizing significantly smaller architectures.
