Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study evaluates various action space representations—pose increment, pose velocity, joint position increment, and joint velocity—in the context of vision-based robotic manipulation tasks, specifically object picking and pushing. By training policies in simulation and transferring them to real-world applications, the authors demonstrate that the choice of action space significantly influences performance, with joint velocity emerging as the most effective representation for achieving smooth motion and high task success. The findings offer critical insights and practical guidance for researchers and practitioners in selecting appropriate action spaces for reinforcement learning applications in robotics.
Choosing the right action space can make or break the performance of vision-based robotic manipulation, with joint velocity proving to be the standout option.
In real-world reinforcement learning (RL), the choice of action space can play a key role in shaping motion smoothness, safety, and overall task performance. In this study, we evaluate pose increment, pose velocity, joint position increment, and joint velocity across two vision-based manipulation tasks: object picking and pushing. We train policies in simulation and deploy them to the real world using sim-to-real transfer. We find that action-space representation indeed significantly affects sim-to-real performance. In particular, we find that the joint velocity action space is best for the vision-based picking and pushing tasks in terms of smoothness and final task performance. We also provide practical guidance for RL practitioners in choosing action spaces for both simulation and real-world experiments.