Search papers, labs, and topics across Lattice.
This paper introduces a novel framework that enhances diffusion policies in robotics by integrating Feynman-Kac correctors with a guiding potential to systematically explore underrepresented action-trajectory distributions. By addressing the limitations of existing methods, which often fail to escape local minima or push samples into infeasible regions, the proposed approach enables the discovery of diverse and executable behaviors in environments with limited demonstrations. Experimental results across various manipulation tasks show a consistent ability to mine and refine new trajectories, significantly expanding the repertoire of behaviors that can be learned by diffusion policies.
By systematically guiding diffusion policies to explore underrepresented behaviors, this framework uncovers novel trajectories that traditional methods often overlook.
Diffusion models have become a powerful tool for generative modeling in robotics, with diffusion policies excelling at modeling multimodal action-trajectory distributions. However, when demonstrations are limited, standard sampling often reproduces dominant behaviors while neglecting valid but rare modes, limiting the discovery of novel solutions. Existing approaches, such as guidance methods or combining reinforcement learning with diffusion, either push samples into infeasible regions or struggle to escape local minima, failing to systematically uncover diverse behaviors. To address these challenges, we propose a framework that combines Feynman-Kac correctors with a novel guiding potential that systematically guides diffusion policy samples towards promising yet underrepresented samples. These trajectories are refined using sampling-based trajectory optimization and reincorporated into the training set to retrain the diffusion policy. Our method effectively mines and repairs novel trajectories, enabling the systematic discovery of diverse and executable behaviors. We demonstrate the effectiveness of our framework across a range of manipulation environments, consistently discovering new behaviors.
