Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
The Ambient Diffusion Policy introduces a novel approach for imitation learning in robotics that effectively utilizes suboptimal data, which is often more accessible than high-quality datasets. By leveraging noise-dependent data usage, the method selectively incorporates useful features from low-quality demonstrations while mitigating harmful influences. Experimental results demonstrate a significant performance improvement, with the policy outperforming existing co-training methods by up to 33% on diverse tasks and datasets, thereby enhancing the utility of suboptimal data in robotic learning.
Suboptimal data can be a goldmine for robotic learning, and Ambient Diffusion Policy unlocks its potential by filtering out the noise that typically hampers performance.
We propose Ambient Diffusion Policy, a simple and principled method for imitation learning from suboptimal data in robotics. High-quality, task-specific robot data is expensive and time-consuming to collect, while suboptimal datasets with lower-quality or out-of-distribution demonstrations are abundant. Existing methods that co-train on both data sources in robotics often fail to separate the meaningful and the harmful features in the suboptimal samples. In contrast, our method extracts only the useful features by introducing a new axis to co-training in robotics: noise-dependent data usage. Ambient Diffusion Policy restricts the contribution of suboptimal data during training to only the high and low diffusion times. To rigorously justify our approach, we first observe that robot action data exhibits a spectral power law. This induces two important properties on the optimal Diffusion Policy that we exploit: a global-to-local hierarchy and locality. We theoretically formalize this discussion using a simplified model. Our experiments validate Ambient Diffusion Policy on four types of suboptimal action data (noisy trajectories, sim-to-real gap, task mismatch, and large-scale data mixtures) across six tasks. The results show that it effectively learns from arbitrary sources of suboptimal data. Notably, it outperforms existing co-training baselines by up to 33% when scaled to Open X-Embodiment - a large dataset with heterogeneous data quality and unstructured distribution shifts. Overall, Ambient Diffusion Policy increases the utility of suboptimal demonstrations and expands the set of usable data sources in robotics.