Search papers, labs, and topics across Lattice.
This paper introduces ContactGuard, a pre-contact execution monitoring system designed to enhance the reliability of visuomotor policies in contact-rich manipulation tasks. By leveraging a latent world model trained on unlabelled robot trajectories, ContactGuard predicts potential failures before contact occurs, allowing for timely abort actions based on short-horizon predictions. The system demonstrates superior failure prediction accuracy compared to existing methods and operates effectively in real-world scenarios without requiring modifications to the underlying policies.
ContactGuard can predict manipulation failures before contact, enabling robots to abort actions and avoid costly mistakes in real-time.
Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper--object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional detectors react. We introduce \emph{ContactGuard}, a pre-contact execution monitor for chunked visuomotor policies. Given the policy's planned action chunk, ContactGuard predicts its short-horizon consequence in latent visual space and aborts if the predicted future latent indicates likely failure. Its latent world model is trained from unlabelled robot trajectories to predict compact multi-view visual embeddings under planned actions, avoiding pixel-level video prediction. A lightweight failure probe is then trained from a small labelled set of pre-contact clips. At deployment, ContactGuard anchors prediction before an imminent contact event, rolls the model forward under the policy's own actions, and verifies the predicted post-contact latent. Across real-world contact-rich manipulation tasks, ContactGuard predicts failure more accurately than direct and corrupted-action ablations, and transfers to live robot as a pre-contact abort signal without modifying the underlying policy.
