Search papers, labs, and topics across Lattice.
This paper introduces a novel framework called Flow as Flow, which models robot velocity fields as probability flows to enhance flow-based object manipulation. By transitioning from sparse keypoint displacements to dense velocity fields, the approach aligns more closely with the continuous nature of robotic motions, resulting in significant improvements in both efficiency and quality of flow generation. Experimental results demonstrate that this method outperforms existing baselines, achieving a 33脳 faster generation rate and a higher average success rate across multiple manipulation tasks.
Achieving 33脳 faster robot flow generation while improving success rates in manipulation tasks could redefine efficiency benchmarks in robotic motion planning.
Cross-embodiment data have become central to training robotic foundation models. To leverage such heterogeneous data, we focus on flow-based object manipulation, where robot flows (robot velocity fields) serve as embodiment-agnostic motion representations. Previous studies do not formulate robot flows as dense velocity fields, but as displacements of sparse keypoints, while such velocity fields better match the continuous-time nature of motions. We propose Flow as Flow, a framework that models robot flows as probability flows based on a flow matching formulation. By naturally modeling such velocity fields within this formulation, our method achieves efficient and high-quality robot flow generation. Across standard benchmarks, our method outperforms representative baseline methods on standard metrics, while achieving approximately 33$\times$ faster generation. Furthermore, through real-world experiments evaluating 9 methods with 260 trials per method across 13 manipulation tasks, we show that our method achieves a higher average success rate than the baseline methods. Our project page is available at https://flow-as-flow-u0n5y.kinsta.page.
