Search papers, labs, and topics across Lattice.
This paper introduces Tri-Info, an information-theoretic framework for predicting failures in Vision-Language-Action (VLA) models by analyzing the distinct information signatures of successful and failed rollouts. The method leverages a closed-loop information pipeline to derive signals that assess action diversity, temporal consistency, and state transition coupling, achieving high accuracy across various architectures and environments. Notably, Tri-Info demonstrates robust performance in real-world tasks, achieving 83% accuracy without the need for retraining, thereby providing interpretable diagnostics of failure modes.
Tri-Info achieves 83% accuracy in real-world failure detection for VLA models without retraining, revealing critical insights into model behavior across diverse tasks.
Vision-Language-Action (VLA) models are increasingly deployed across diverse tasks, yet they remain black boxes whose physical interactions can cause irreversible harm, making generalizable and interpretable failure detection essential. We observe that successful and failed rollouts carry systematically different information-theoretic signatures. Building on this, we formalize VLA control as a closed-loop information pipeline and derive the Triple Information-theoretic (Tri-Info) signals that capture whether actions remain diverse, temporally consistent, and coupled to state transitions. Across six VLA models and three benchmark environments, Tri-Info matches the strongest baselines in-domain. Moreover, Tri-Info transfers across architectures, environments, and the sim-to-real gap without retraining, reaching 83\% accuracy on real-world tasks where prior detectors collapse to chance. This establishes Tri-Info as a simple yet powerful method that not only detects failures with strong cross-domain generalization, but also delivers interpretable diagnostics of the underlying failure modes.
