Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to adaptively adjust the execution horizon of action chunks in robotic learning from demonstration, addressing the trade-off between responsiveness and computational cost. By leveraging Spatial Attention, which quantifies the sensitivity of the policy's action distribution to observation changes, the authors dynamically assign execution horizons based on the anticipated variability in observations. Experimental results demonstrate that this method significantly enhances success rates on both standard and perturbed tasks, outperforming traditional fixed-horizon strategies while preserving average execution times.
Adaptive execution horizons based on observation sensitivity can drastically improve robotic task success rates without increasing computational costs.
Sampling action chunks via generative models has become a widely adopted methodology for robotic learning from demonstration. However, existing methods often struggle to balance responsiveness and computational cost because they execute each action chunk for a fixed execution horizon. In this paper, we adaptively adjust the execution horizon of sampled action chunks, balancing responsiveness and computational efficiency. We introduce Spatial Attention -- defined as the expected squared norm of the gradient of the action log-likelihood with respect to the observation -- which indicates the sensitivity of the policy's action distribution to variations in the observation. We show that, under a fixed budget of chunk samplings, the execution horizon that minimizes the cumulative likelihood drop induced by disturbances decreases as Spatial Attention increases. By forecasting future Spatial Attention values alongside the action chunk, our framework dynamically assigns shorter execution horizons to phases with high Spatial Attention, and longer horizons to phases with low Spatial Attention. Experiments on standard and perturbed tasks, in both simulation and on a real robot, show that our method significantly improves success rates over fixed-horizon baselines while maintaining the average execution horizon.
