Search papers, labs, and topics across Lattice.
The paper introduces Primary-Fine Decoupling for Action Generation (PF-DAG), a two-stage imitation learning framework designed to address multi-modal action distributions in robotic manipulation. PF-DAG first discretizes action chunks into a small set of modes for coarse action selection, then uses a mode-conditioned MeanFlow policy to generate continuous, high-fidelity actions. The authors theoretically prove and empirically demonstrate that this decoupling approach achieves lower MSE and outperforms state-of-the-art methods on Adroit, DexArt, and MetaWorld benchmarks, as well as real-world tasks.
By decoupling coarse action consistency from fine-grained variations, PF-DAG achieves state-of-the-art imitation learning performance in robotic manipulation tasks.
Multi-modal distribution in robotic manipulation action sequences poses critical challenges for imitation learning. To this end, existing approaches often model the action space as either a discrete set of tokens or a continuous, latent-variable distribution. However, both approaches present trade-offs: some methods discretize actions into tokens and therefore lose fine-grained action variations, while others generate continuous actions in a single stage tend to produce unstable mode transitions. To address these limitations, we propose Primary-Fine Decoupling for Action Generation (PF-DAG), a two-stage framework that decouples coarse action consistency from fine-grained variations. First, we compress action chunks into a small set of discrete modes, enabling a lightweight policy to select consistent coarse modes and avoid mode bouncing. Second, a mode conditioned MeanFlow policy is learned to generate high-fidelity continuous actions. Theoretically, we prove PF-DAG's two-stage design achieves a strictly lower MSE bound than single-stage generative policies. Empirically, PF-DAG outperforms state-of-the-art baselines across 56 tasks from Adroit, DexArt, and MetaWorld benchmarks. It further generalizes to real-world tactile dexterous manipulation tasks. Our work demonstrates that explicit mode-level decoupling enables both robust multi-modal modeling and reactive closed-loop control for robotic manipulation.
