Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
RoboPocket introduces a portable system using smartphones for robot-free instant policy iteration, addressing the data collection bottleneck in imitation learning. It employs a Remote Inference framework with AR Visual Foresight to visualize predicted trajectories, enabling operators to proactively identify and correct policy weaknesses without a physical robot. An asynchronous online finetuning pipeline then continuously updates the policy with new data, achieving a closed learning loop in minutes and doubling data efficiency compared to offline scaling.
Imagine fixing your robot's mistakes *before* it even makes them: RoboPocket lets you train robots twice as efficiently using just your smartphone and AR.
Scaling imitation learning is fundamentally constrained by the efficiency of data collection. While handheld interfaces have emerged as a scalable solution for in-the-wild data acquisition, they predominantly operate in an open-loop manner: operators blindly collect demonstrations without knowing the underlying policy's weaknesses, leading to inefficient coverage of critical state distributions. Conversely, interactive methods like DAgger effectively address covariate shift but rely on physical robot execution, which is costly and difficult to scale. To reconcile this trade-off, we introduce RoboPocket, a portable system that enables Robot-Free Instant Policy Iteration using single consumer smartphones. Its core innovation is a Remote Inference framework that visualizes the policy's predicted trajectory via Augmented Reality (AR) Visual Foresight. This immersive feedback allows collectors to proactively identify potential failures and focus data collection on the policy's weak regions without requiring a physical robot. Furthermore, we implement an asynchronous Online Finetuning pipeline that continuously updates the policy with incoming data, effectively closing the learning loop in minutes. Extensive experiments demonstrate that RoboPocket adheres to data scaling laws and doubles the data efficiency compared to offline scaling strategies, overcoming their long-standing efficiency bottleneck. Moreover, our instant iteration loop also boosts sample efficiency by up to 2$\times$ in distributed environments a small number of interactive corrections per person. Project page and videos: https://robo-pocket.github.io.