Search papers, labs, and topics across Lattice.
This paper introduces VR-DAgger, a system leveraging immersive virtual reality (VR) for efficient collection of robotic manipulation demonstrations and uncertainty-guided on-policy correction. By allowing experts to teleoperate robots in VR, the system accelerates data collection and focuses expert interventions on high-uncertainty regions of the state space. Experiments show VR-DAgger significantly improves data efficiency and final task performance compared to standard DAgger, particularly in scenarios with distribution shift.
Forget tedious robot training: VR-DAgger lets you teleoperate robots in VR, slashing data needs and boosting performance by focusing expert corrections where the robot is most uncertain.
Learning from demonstrations is effective for robotic manipulation, but collecting sufficient task-specific data remains a major bottleneck. Under distribution shift, small errors compound, performance degrades, and expert time is often spent on redundant, low-value corrections instead of the few critical failure cases.
