Search papers, labs, and topics across Lattice.
This paper introduces the Set-Supervised Diffusion Policy (SDP), a novel framework that leverages human corrections to enhance the robustness of diffusion policies in robotic manipulation. By utilizing contrastive action-chunk data, SDP effectively constructs a set of desired actions that guide the learning process, addressing the limitations of traditional behavior cloning methods that often overlook negative signals from undesired actions. Experimental results across various tasks reveal that SDP not only improves overall policy performance but also increases resilience to noisy data, thereby reducing dependence on expert interventions.
SDP transforms human corrections into a powerful learning signal, significantly boosting policy robustness and efficiency in robotic manipulation tasks.
Diffusion policies have recently emerged as a powerful framework for robotic manipulation. However, like other behavior cloning methods, they remain vulnerable to distributional shift, often requiring human-in-the-loop interventions to correct failures during deployment. These interactions naturally provide paired supervision in the form of the robot's undesired actions and the human teacher's corrective actions. Yet existing data aggregation pipelines and standard behavior cloning losses largely ignore this negative signal from undesired actions, leading to overfitting to teacher's actions and an increasing reliance on costly expert data. To address this limitation, we propose Set-Supervised Diffusion Policy (SDP), a novel learning framework that utilizes contrastive action-chunk data to train diffusion policies from human corrections. From paired positive and negative action-chunks, SDP constructs a set of desired action-chunks and designs a training pipeline that encourages the diffusion policy to align with the set. Through extensive experiments across multiple robotic manipulation tasks, we demonstrate that SDP consistently improves policy performance, with particularly strong gains in robustness to noisy data. Moreover, SDP induces high-quality aggregated datasets, enabling more efficient and reliable policy learning from human-in-the-loop corrections. Our code is available at https://set-supervised-diffusion-policy.github.io/.
