Search papers, labs, and topics across Lattice.
This paper introduces the Deliberate Practice (DP) algorithm, which autonomously allocates limited practice time for robots learning sequential tasks to maximize expected cumulative rewards. By estimating the mastery time for skills and the rewards from task plans, DP addresses the challenge of optimizing practice under budget constraints through a bilinear programming approach. Experimental results demonstrate that DP enables robots to effectively utilize restricted practice time to develop useful policies and enhance long-horizon planning capabilities.
Robots can now learn complex skills more efficiently, achieving optimal performance even with limited practice time.
We consider the problem of autonomously learning robot skills under a limited practice budget for sequential tasks. We propose an active skill learning algorithm, \emph{Deliberate Practice (DP)}, that computes a provably \emph{budget-optimal} allocation---practicing skills that maximize expected cumulative reward while being learnable within the budget. DP estimates both the time needed to master skills and the cumulative reward of the task plans that the skills unlock. Computing a budget-optimal allocation is challenging as it requires reasoning about combinatorially many skill plans over a large practice budget. Our key contribution is a bilinear program that can compute this exactly using off-the-shelf solvers. Through simulated and real-world experiments on long-horizon manipulation tasks, we show that our approach allows robots to optimally use limited practice time to acquire useful policies and improve long-horizon planning.
