Search papers, labs, and topics across Lattice.
This paper investigates the failure modes of Vision-Language-Action (VLA) models in contact-rich manipulation tasks, revealing that precision failures stem from a mismatch in flow-matching policy training, while force failures are linked to the unique characteristics of force signals. By addressing these issues with targeted mechanisms, the authors introduce FACT, a novel approach that significantly improves performance. FACT achieves a 66% average success rate across five contact-rich tasks, outperforming the best prior baseline by 25% in nearly 2,500 real-world rollouts.
VLA models can achieve a 66% success rate in contact-rich tasks by addressing precision and force failure modes, a leap from the previous 41% benchmark.
We address the problem of understanding when and why Vision-Language-Action models struggle with contact-rich manipulation tasks that require precise physical interaction. Prior work has primarily focused on addressing contact failures through force-augmented architectures and training-time regularizers, yet the root causes of these failures remain underexplored. We identify two distinct failure modes underlying this gap. Precision failures are rooted in a flow-matching policy training mismatch, and force failures arise from the distinctive structure of force signals. We address each failure mode with a targeted mechanism and combine them into FACT, which achieves 66% average success rate across five contact-rich tasks against 41% for the best prior baseline, in an evaluation spanning almost 2,500 real-world rollouts.
Stanford HAI