Search papers, labs, and topics across Lattice.
This paper introduces Frequency-Aware Flow Matching (FAFM), a novel approach that enhances robotic action generation by enabling continuous and temporally consistent outputs, addressing the limitations of existing methods that rely on discretized action chunks. By transforming discrete action sequences into the frequency domain using the discrete cosine transform (DCT) and applying flow matching to the coefficients, FAFM effectively handles heterogeneous control frequencies and promotes smooth action transitions through a Sobolev-type regularization. Experimental results across various benchmarks, including real-world applications, demonstrate significant improvements in success rates, motion smoothness, and robustness to input variability without increasing network complexity.
Continuous and consistent robotic actions can be achieved without additional network parameters, revolutionizing how robots interpret and execute complex tasks.
Flow matching has emerged as a standard paradigm for robotic manipulation owing to its strong expressive power for modelling complex, multimodal action distributions, alongside similar approaches like diffusion policy. However, existing methods rely on discretized action chunks, making them brittle to demonstrations collected at heterogeneous control frequencies and prone to temporally inconsistent actions that degrade control stability. In this paper, we propose Frequency-Aware Flow Matching (FAFM), which outputs continuous, temporally consistent actions. To handle heterogeneous frequency input, we transform discrete action sequences into the frequency domain with the discrete cosine transform (DCT), perform flow matching over the resulting coefficients, and reconstruct continuous actions via cosine basis expansion. To generate temporally consistent actions, we regularize the first-order temporal derivative to promote smooth actions. This corresponds to a Sobolev-type constraint that suppresses high-frequency errors and discourages abrupt action changes. Our FAFM is simple, introduces no additional network parameters and applies to standalone flow-matching policies and vision-language action models. Across synthetic toy benchmark, obstacle avoidance, LapGym, and LIBERO, FAFM improves success rates, multimodal expressivity, motion smoothness, convergence speed, robustness to mechanical bias and mixed-frequency input. These gains are consistent when deployed on a real-world Franka robot. Code available at https://anonymous.4open.science/r/FAFM.
