Search papers, labs, and topics across Lattice.
This paper introduces a novel guidance method for action-only diffusion policies that leverages a learned world model to evaluate Signal Temporal Logic (STL) robustness, allowing for effective constraint satisfaction during inference. By injecting the gradient of STL robustness into the diffusion process, the method enhances adherence to human-defined constraints without the need for retraining. The results on the Can Transport task demonstrate a significant reduction in constraint violations from over 80% to just 4%, while maintaining a perfect task success rate.
Action-only diffusion policies can now satisfy complex human-defined constraints with minimal runtime overhead, achieving 100% task success and drastically reducing violations.
Diffusion policies enable multimodal robot behavior but offer limited ability to choose among behavior modes at inference time, even though such control is desirable in human-robot settings. Prior solutions to this lack of control have utilized Signal Temporal Logic (STL) to express human intentions and provide corresponding guidance for diffusion policy inference. However, these approaches can only guide diffusion policies that jointly generate future actions and states, increasing both complexity and runtime. We propose a novel guidance method for action-only diffusion policies that uses a separate learned world model to enable differentiable evaluation of STL robustness, with its gradient then injected into the diffusion process. This steers behavior toward constraint satisfaction without retraining, improving constraint adherence while preserving task performance. On the Can Transport task from Robomimic, our method maintains 100% task success while reducing constraint violations from over 80% for baseline methods to 4%. We also discuss extensions toward improved robustness and more complex constraints.
