Search papers, labs, and topics across Lattice.
This paper introduces RAPAC-DP, a framework designed to mitigate the performance degradation of imitation-learning policies due to communication and computation delays in cloud-side inference. By encoding scheduled actions into a pending-action sequence, RAPAC-DP allows for effective compensation without requiring additional delayed demonstrations or knowledge of system dynamics. The framework achieved an impressive retention of 81.4% of delay-free performance under significant delays in Kinetix and a mean success rate of 0.633 across multiple RoboMimic tasks, showcasing its effectiveness in real-world applications.
Delays in cloud-side inference can be effectively compensated, retaining over 80% performance in imitation-learning tasks even under significant latency.
Cloud-side inference gives imitation-learning policies access to greater computational resources, but communication and computation delays can degrade control performance. To compensate for these delays, we propose RAPAC-DP, a response-aligned pending-action compensation framework designed for both diffusion- and flow-based action generators. RAPAC-DP encodes the actions already scheduled for execution before the cloud response arrives into a pending-action sequence that serves as the conditioning input to a parameter-efficient compensation pathway. When delay effects are negligible, bypassing this pathway exactly recovers the frozen base policy. For training, RAPAC-DP constructs delay-conditioned samples from delay-free demonstrations, requiring neither explicit system dynamics nor additional delayed demonstrations. At the largest fixed delay tested on Kinetix, RAPAC-DP retained 81.4% of its overall delay-free performance. At the largest fixed delay tested on each RoboMimic task, it achieved a mean success rate of 0.633 across the three tasks. These results demonstrate the effectiveness of pending-action compensation for cloud-deployed imitation-learning policies.
