Search papers, labs, and topics across Lattice.
This paper introduces actuator reality shaping, a novel approach that modifies the closed-loop behavior of physical actuators to align with idealized dynamics used in simulation, rather than enhancing simulator fidelity. By implementing a two-degree-of-freedom feedforward-feedback controller for each joint, the method allows for zero-shot deployment of reinforcement learning policies on real hardware without the need for task-level fine-tuning. Experimental results show significant reductions in sim-to-real tracking error and improved performance across various robotic tasks, indicating the method's versatility across different hardware platforms.
Zero-shot deployment of RL policies on real robots is now achievable without fine-tuning, thanks to a novel actuator reality shaping method.
Sim-to-real transfer in robot learning is often limited by discrepancies between the ideal actuator dynamics assumed during policy training and the nonlinear, hardware-dependent behavior of physical motors. While conventional approaches attempt to bridge this gap by increasing simulator fidelity through system identification, domain randomization, or learned actuator models, we introduce an alternative paradigm: actuator reality shaping. Instead of modifying the simulator to match the real world, our method shapes the closed-loop behavior of physical actuators to match the idealized second-order reference dynamics used in simulation. By equipping each joint with a two-degree-of-freedom feedforward--feedback controller, we decouple reference-response shaping from robust stabilization, thereby providing a standardized actuator interface for reinforcement learning policies. As a result, policies trained only with the prescribed reference model can be deployed zero-shot on real hardware without task-level fine-tuning or learned actuator models. We validate the approach on a single-joint high-gear-ratio servo under external loads and a 7-DOF robotic arm reaching task, where actuator reality shaping substantially reduces sim-to-real tracking error and improves zero-shot task performance compared with standard servo-control and representative real-to-sim-to-real baselines. We further demonstrate zero-shot transfer on a wheeled-legged robot driving over a slope and a humanoid robot walking, suggesting that actuator reality shaping can serve as a reusable interface for robot learning across diverse hardware platforms.
