Search papers, labs, and topics across Lattice.
The paper introduces FlowCorrect, a deployment-time framework for correcting failures in generative manipulation policies by incorporating sparse human pose nudges obtained through a VR interface. This method locally adapts the policy based on these corrections, improving actions without full retraining and preserving performance on previously learned scenarios. Experiments on a real-world robot performing tabletop tasks (pick-and-place, pouring, cup uprighting) show that FlowCorrect improves success rates by 85% on hard cases with a low correction budget.
Rescue your robot's near-miss manipulation failures with FlowCorrect, a VR-guided, human-in-the-loop correction framework that boosts success rates by 85% without full retraining.
Generative manipulation policies can fail catastrophically under deployment-time distribution shift, yet many failures are near-misses: the robot reaches almost-correct poses and would succeed with a small corrective motion. We present FlowCorrect, a deployment-time correction framework that converts near-miss failures into successes using sparse human nudges, without full policy retraining. During execution, a human provides brief corrective pose nudges via a lightweight VR interface. FlowCorrect uses these sparse corrections to locally adapt the policy, improving actions without retraining the backbone while preserving the model performance on previously learned scenarios. We evaluate on a real-world robot across three tabletop tasks: pick-and-place, pouring, and cup uprighting. With a low correction budget, FlowCorrect improves success on hard cases by 85\% while preserving performance on previously solved scenarios. The results demonstrate clearly that FlowCorrect learns only with very few demonstrations and enables fast and sample-efficient incremental, human-in-the-loop corrections of generative visuomotor policies at deployment time in real-world robotics.
