Search papers, labs, and topics across Lattice.
This paper introduces a novel approach that combines quality-diversity (QD) algorithms with language-driven techniques to enable robots to autonomously acquire diverse motion manipulation skills. By utilizing a free-form task description and an LLM-based exploration mechanism, the method circumvents the need for expert-designed fitness and diversity metrics, allowing for greater adaptability in real-world applications. Experimental results demonstrate that this approach generates superior archives of motion primitives compared to traditional QD methods, significantly enhancing robotic performance across multiple manipulation tasks.
Robots can now autonomously generate diverse manipulation strategies from simple language descriptions, outperforming traditional methods that rely on expert-defined metrics.
Quality-diversity (QD) algorithms have been gaining traction in robot learning, where diverse motion primitive libraries allow robots to adapt zero-shot to constraints at deployment time. However, such methods typically require expert designers to write the success condition, fitness and diversity metrics, and this strongly limits the robot's autonomy. On the other hand, existing LLM-based reward-shaping techniques allow robots to learn autonomously but only output single high-performing solutions, limiting the robot's adaptability. In this paper, we propose an approach designed to output diverse motion primitive archives by autonomously leveraging quality-diversity algorithms, only requiring a free-form description of the task in common language. To address the difficulty of designing relevant fitness and diversity metrics, we propose an autonomous exploration mechanism able to reliably output sets of functionals covering the fitness and behavior descriptor (BD) space. First, we pose policy exploration as a functional design problem, where the functional spaces are lower-dimensional than the full BD and fitness spaces, and propose an LLM-based exploration scheme to sample from these low-dimensional spaces without any task-specific prompts, fine-tuning or expert intervention. We adapt a multi-BD variant of the MAP-Elites success (MES) algorithm, designed to leverage the heterogeneous BD samples. Finally, through experiments based on the genesis simulator, we show that our method effectively generates archives of diverse motion primitives, outperforming classical QD algorithms with inferred and hand-written parametrizations on a set of $4$ robotic manipulation tasks.
