Search papers, labs, and topics across Lattice.
The paper introduces AICA-Bench, a new benchmark to evaluate Vision-Language Models (VLMs) on holistic Affective Image Content Analysis (AICA) across three tasks: Emotion Understanding, Emotion Reasoning, and Emotion-Guided Content Generation. Evaluation of 23 VLMs reveals weaknesses in intensity calibration and descriptive depth. To mitigate these limitations, they propose Grounded Affective Tree (GAT) Prompting, a training-free framework leveraging visual scaffolding and hierarchical reasoning, which improves performance and establishes a strong baseline.
VLMs struggle to understand and generate nuanced emotional content in images, but a new prompting strategy closes the gap without training.
Vision-Language Models (VLMs) have demonstrated strong capabilities in perception, yet holistic Affective Image Content Analysis (AICA), which integrates perception, reasoning, and generation into a unified framework, remains underexplored. To address this gap, we introduce AICA-Bench, a comprehensive benchmark with three core tasks: Emotion Understanding (EU), Emotion Reasoning (ER), and Emotion-Guided Content Generation (EGCG). We evaluate 23 VLMs and identify two major limitations: weak intensity calibration and shallow open-ended descriptions. To address these issues, we propose Grounded Affective Tree (GAT) Prompting, a training-free framework that combines visual scaffolding with hierarchical reasoning. Experiments show that GAT reduces intensity errors and improves descriptive depth, providing a strong baseline for future research on affective multimodal understanding and generation.