Search papers, labs, and topics across Lattice.
This paper introduces ActProbe, a novel action-space failure detection method for generative robot policies that leverages Temporal Consistency Error (TCE) and Action Chunk Magnitude (ACM) to predict failures before they manifest visually. By employing a task-conditioned LSTM-MLP architecture, ActProbe effectively maps these signals to per-step failure probabilities, achieving significant improvements in detection accuracy and timeliness. The method demonstrates a +12.7% hypervolume gain in the accuracy-timeliness Pareto frontier and enhances real-robot task performance by reducing required interactions during reinforcement learning fine-tuning by 2.9 times.
ActProbe predicts robot policy failures before they become visually apparent, enhancing both detection accuracy and operational efficiency in real-world tasks.
Generative robot policies fail unpredictably at deployment: they hesitate at critical moments, drift off-task, or commit to unrecoverable actions. Existing online failure detectors either require white-box access to policy internals or add runtime overhead through resampling and observation-side signals. Our empirical analysis shows that emitted action chunks themselves already carry strong predictive signal for impending failures in generative robot policies. Motivated by this observation, we introduce ActProbe, a lightweight, pure action-space detector that uses two compact signals available from a single forward pass: Temporal Consistency Error (TCE) between consecutive action chunks and Action Chunk Magnitude (ACM) of the current chunk. ActProbe maps these signals to per-step failure probabilities with a task-conditioned LSTM-MLP architecture. Across a diverse suite of generative robot policies and benchmarks, ActProbe raises alerts before failures become visually recognizable, improving the accuracy (F1)-timeliness Pareto frontier of failure detection by an average hypervolume gain of +12.7% over both internal- and external-feature baselines, with a +9.0% early-detection ROC-AUC lead on unseen tasks. ActProbe further transfers to deployment, predicting failures on unseen real-robot pick tasks and accelerating RL fine-tuning (PPO) with 2.9x fewer environment interactions.
Tsinghua AI