Search papers, labs, and topics across Lattice.
This paper introduces an open-source teleoperation framework for mobile bimanual manipulators that utilizes commodity hardware like smartphones, leader arms, and foot pedals to provide intuitive whole-body control. The system replaces expensive VR setups with smartphone-based head tracking for camera control and integrates with the XLeRobot framework. User studies demonstrate that the proposed system improves task performance and reduces cognitive load compared to traditional keyboard-based control.
Swap that pricey VR headset for a smartphone: this open-source teleoperation framework delivers intuitive whole-body control of mobile manipulators using readily available commodity hardware.
Teleoperation of mobile bimanual manipulators requires simultaneous control of high-dimensional systems, often necessitating expensive specialized equipment. We present an open-source teleoperation framework that enables intuitive whole body control using readily available commodity hardware. Our system combines smartphone-based head tracking for camera control, leader arms for bilateral manipulation, and foot pedals for hands-free base navigation. Using a standard smartphone with IMU and display, we eliminate the need for costly VR helmets while maintaining immersive visual feedback. The modular architecture integrates seamlessly with the XLeRobot framework, but can be easily adapted to other types of mobile manipulators. We validate our approach through user studies that demonstrate improved task performance and reduced cognitive load compared to keyboard-based control.
