Search papers, labs, and topics across Lattice.
This paper introduces Online Residual Policy Adaptation (ORPA), a novel framework that enables real-time, feedback-driven corrections for robotic manipulation tasks without the need for full-policy retraining. By integrating a lightweight, feedback-conditioned module that predicts residual adjustments in joint space, ORPA enhances the performance of pretrained control policies under challenging conditions. Evaluations on precision-sensitive tasks reveal that ORPA significantly improves success rates and recovery from execution errors compared to traditional methods and baseline policies.
Immediate feedback-driven corrections can enhance robotic manipulation performance without the overhead of retraining entire policies.
Robotic manipulation policies trained via imitation learning, such as Action Chunking with Transformers (ACT), can achieve strong performance under ideal conditions but often remain sensitive to small execution errors and distribution shifts. Correcting these failures typically requires dataset aggregation and full-policy retraining, which is computationally expensive and unsuitable for real-time deployment. In this work, we propose Online Residual Policy Adaptation (ORPA), a framework that enables immediate, feedback-driven correction of robot actions without modifying the underlying policy parameters. ORPA augments a pretrained control policy with a lightweight, feedback-conditioned module that predicts residual adjustments directly in joint space, allowing the system to adapt its behavior at runtime. We evaluate ORPA on a set of precision-sensitive manipulation tasks using the ALOHA platform, demonstrating improvements in success rate and recovery from small perturbations compared to baseline control policies and rule-based inverse kinematics corrections.
