Search papers, labs, and topics across Lattice.
This paper introduces Action ControlNet (ACNet), a lightweight adapter designed to enhance the performance of vision-language-action (VLA) models by addressing inference latency issues in robot manipulation. By leveraging the executed motion suffix as a residual condition, ACNet enables smoother asynchronous control without the need for extensive retraining or complex runtime adjustments. Experimental results demonstrate that ACNet significantly improves robustness to inference delays and produces smoother trajectories compared to traditional chunk stitching methods across various benchmarks, including real-world applications.
ACNet achieves smoother asynchronous control in robot manipulation by effectively utilizing executed motion data, outperforming traditional methods without heavy retraining.
Vision-language-action (VLA) models have shown strong potential for general-purpose robot manipulation, but their inference latency remains a major obstacle to stable high-frequency control. Asynchronous execution mitigates this bottleneck by overlapping policy inference with action execution, yet the next action chunk is still predicted from stale observations while the robot continues to move. Direct chunk stitching therefore introduces handoff discontinuities, action jitter, and failures in contact-rich manipulation. Existing remedies typically require either full-policy retraining or architecture-specific runtime logic. This work proposes Action ControlNet (ACNet), a lightweight delay-aware adapter that uses the executed motion suffix as a residual condition for a mostly frozen action head. ACNet leaves the pretrained backbone unchanged, introduces few trainable parameters, and remains compatible with generative action heads such as diffusion and flow matching. On Kinetix, Meta-World MT50, and a real-world SO-ARM101 platform, ACNet improves robustness under inference delay and yields smoother asynchronous trajectories than direct chunk stitching, while remaining more lightweight than full delay-conditioned retraining.
