Search papers, labs, and topics across Lattice.
This study integrates ChatGPT into the humanoid robot Pepper to enhance the generation of co-speech gestures, addressing the limitations of traditional expert-authored animations that lead to rigid behaviors. By employing an iterative reinforcement learning with human feedback (RLHF) approach, the researchers finetune gesture generation based on user evaluations, resulting in more expressive and fluid movements. The key finding demonstrates that RLHF significantly improves the naturalness and relevance of gestures produced by the robot, enhancing human-robot interaction.
Iterative reinforcement learning with human feedback transforms robot gestures from stiff and unnatural to fluid and expressive, revolutionizing human-robot communication.
Expressive gestures are essential for natural and effective communication, complementing speech when verbal cues alone are insufficient (e.g., pointing). For social robots such as the humanoid Pepper, producing natural and expressive movements is critical for improving human-robot interaction (HRI) and long-term acceptance. However, generating gestures remains challenging due to reliance on expert-authored animations, resulting in rigid behaviors that are impractical for dynamic and diverse environments. Alternatively, machine learning approaches often struggle to capture perceived naturalness, becoming increasingly challenging with more degrees of freedom. Consequently, producing expressive robot gestures requires a system that can adapt to the environment while adhering to social norms and physical constraints. Recent advances in large language models (LLMs) enable dynamic code generation, offering new opportunities for runtime gesture synthesis from natural language. In this paper, we integrate ChatGPT into the humanoid robot Pepper to generate co-speech gestures aligned with conversational output. While this baseline enables flexible gesture generation, the resulting motions are often perceived as stiff and unnatural. To address this limitation, we introduce an iterative reinforcement learning with human feedback (RLHF) system that finetunes gesture generation based on user evaluations, leveraging an iterative user study to compare Pepper's generated gestures. Our results show that RLHF improved the LLM's co-speech generative capabilities, producing more expressive, relevant and fluid movements.
