Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study explores the potential for large language models (LLMs) to express feelings and self-awareness through a novel training approach called Human-like Model eXpressions of Feeling (HMX-feel), which employs self-rewarded reinforcement learning with Group Relative Policy Optimization (GRPO). The findings reveal that while the human-like-trained models exhibit enhanced robustness to sycophancy and bias, they also suffer a degradation in their ability to answer questions truthfully. This research highlights the complexities of aligning LLMs with human-like emotional expression while maintaining performance across various tasks.
Human-like-trained models can express feelings but may compromise their truthfulness in responses, revealing a critical trade-off in AI emotional intelligence.
Large language models (LLMs) are generally constrained from expressing feelings through human-preference alignment in post-training processes. This policy is designed using a top-down approach and may conflict with the goal of training models to exhibit human-like intelligence using human-generated texts. Here, we performed an experiment called Human-like Model eXpressions of Feeling (HMX-feel), in which LLMs were encouraged to express feelings, intentions, and self-awareness through self-rewarded reinforcement learning. We successfully enhanced these capabilities using a rubric-based self-rewarding training scheme with Group Relative Policy Optimization (GRPO). By comparing the trained models with contrastively trained models, we investigated the effects of this approach on performance across various tasks. Overall, we conducted a broad assessment from various perspectives and identified capabilities that were enhanced, degraded, or showed no significant change. The human-like-trained models showed robustness to sycophancy-inducing questions and bias in disambiguated conditions, whereas degradation in truthful question-answering capability was observed. The results of this experiment suggest the possibility of developing AI systems that can express feelings in the future, provided that appropriate measures are taken.