Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
FailPatch leverages unlabeled robot execution failures by decoupling nominal action supervision from reliability supervision via a Null-gated Residual Expert Bank inserted into a frozen VLA's action hidden space. Exploiting the linear separability of success and failure representations in latent space, it trains the experts using a Preserve–Redirect–Trust objective that leaves reliable states untouched while steering failure-bound representations toward successful manifolds under bounded intervention. With only 0.52% trainable parameters, the approach yields an 11.0 percentage point gain on long-horizon RoboTwin simulation tasks and a 16.7 percentage point improvement across real-world robotic manipulation benchmarks.
Unlabeled robot deployment failures don't need expensive corrective demonstrations to be useful: steering linearly separable latent states away from failure modes fixes policy execution with just 0.5% added parameters.
Vision-Language-Action (VLA) policies are typically adapted using successful demonstrations, which provide direct action supervision but rarely cover failure-prone states. Deployment failures expose these states, yet lack the corrective actions needed for conventional supervised learning. We propose FailPatch, a failure-driven residual patching framework that decouples action supervision from execution-reliability supervision. Successful demonstrations ground how the policy should act, while deployment trajectories indicate when its behavior becomes unreliable. We further observe that action hidden representations exhibit clear linear separability between reliable and failure-associated states while directly conditioning action generation. Building on these insights, FailPatch introduces a Null-gated Residual Expert Bank into the action hidden space of a frozen VLA policy. A unified Preserve--Redirect--Trust objective retains the original policy in reliable states, selects residual experts in failure-associated states and redirects representations from failure regions toward success-associated regions under bounded intervention. With only 0.52% trainable parameters, FailPatch improves success rates by 11.0 percentage points on four long-horizon RoboTwin tasks under clean evaluation, 9.5 percentage points under clean-to-random generalization, and 16.7 percentage points over the baseline across three real-world tasks. Project and code: https://github.com/yupeng-2003/FailPatch.