Search papers, labs, and topics across Lattice.
This paper introduces ReART, a reference-guided retrieval and refinement framework designed for emotion-aware artistic image generation that effectively balances semantic content, artistic style, and target emotion. By decomposing captions and image annotations into structured visual fields, ReART retrieves role-specific visual references to enhance the synthesis process, addressing the challenge of underspecified artistic captions. The method's effectiveness is demonstrated through its second-place ranking in the AffectiveArt 2026 Grand Challenge, achieving a perfect Attribute Alignment Score (AAS) of 1.00 and an overall score of 0.78.
Emotion-aware art generation just got a major upgrade with ReART, achieving perfect alignment with target emotions through structured visual retrieval.
Emotion-aware artistic image generation requires a model to satisfy semantic content, artistic style, and target emotion simultaneously. The key challenge is that artistic captions conflate these axes into underspecified free-form text, making fine-grained visual attributes such as brushwork, composition, and tonal atmosphere difficult to ground concretely. We present ReART, a reference-guided retrieval and refinement framework. Our method decomposes test captions and each image annotation in the EmoArt database into structured visual fields, and performs field-wise retrieval over subject, layout, brush-line, and tone-mood dimensions to retrieve role-specific visual references that supply the perceptual detail text alone cannot convey; these references are used alongside a structured prompt for initial synthesis. For samples where any Attribute Alignment Score (AAS) axis falls below threshold, an AAS-driven refinement loop diagnoses failures, constructs constrained repair plans specifying elements to keep, errors to fix, and operations to avoid, routes references by correction purpose, and performs controlled editing under structural preservation constraints. Our system ranks 2nd in Track 1 of the AffectiveArt 2026 Grand Challenge, achieving a perfect AAS of 1.00 and an overall score of 0.78. Code is available at https://github.com/oceanflowlab/ReART.git.
Tsinghua AI