Search papers, labs, and topics across Lattice.
This study introduces an emotion-aware text-to-image (T2I) pipeline that translates short Korean diary entries into children's hand-drawn style images, addressing the limitations of existing models in capturing sentiment. By leveraging Qwen3-8B for sentiment recognition and fine-tuning Stable Diffusion 3.5 Medium with LoRA on emotion-triggered images, the authors demonstrate improved emotional fidelity in generated visuals. Key experiments reveal the significant impact of emotion trigger words on image quality, while also critiquing the use of CLIP Score as a metric for evaluating emotional accuracy in T2I outputs.
Emotion-aware image generation can transform how we visualize personal narratives, revealing deeper emotional contexts in children's drawings.
T2I models cannot effectively capture sentiment from various types of text, including diaries, as they primarily focus on visual object-related patterns rather than contextual emotional understanding. This paper proposes an emotion-aware text-to-image pipeline that generates children's hand drawing style images from short Korean diary entries. The proposed pipeline employs Qwen3-8B for recognising implicit sentiment from short diaries, and Stable Diffusion 3.5 Medium fine-tuned with LoRA on children's drawing images with emotion-based trigger words for image generation. Additionally, this paper presents experiments examining the effect of emotion trigger words on generated images and discusses the limitations of CLIP Score as an evaluation metric for emotion-aware image generation.
