Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the Multimodal Adaptive Few-Shot Prompting (MAF) framework, which enhances sentiment analysis in multimodal large language models (MLLMs) by dynamically retrieving context-relevant demonstrations. By employing a demonstration retrieval module that integrates facial expressions, scene context, and textual semantics, MAF optimizes prompt design to better capture nuanced sentiment cues. Experimental results show that MAF significantly outperforms traditional prompting methods and remains competitive with leading multimodal sentiment analysis approaches, highlighting its effectiveness in real-world applications.
Dynamic retrieval of context-sensitive demonstrations boosts sentiment analysis accuracy in MLLMs, outperforming static prompt designs.
Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in understanding complex multimodal content. However, their performance in sentiment analysis exhibits acute sensitivity to prompt design, rendering static, uniformly applied prompts inherently suboptimal for capturing the nuanced multimodal cues that vary across inputs. To address this limitation, we propose a Multimodal Adaptive Few-Shot Prompting (MAF) framework, which dynamically retrieves and integrates query-relevant demonstrations to elicit the sentiment reasoning capabilities of MLLMs in a context-sensitive manner. MAF constructs a demonstration retrieval module that holistically encodes facial expressions, scene context, and textual semantics, with a lip movement amplitude detection mechanism introduced for accurate speaker identification in multi-person scenarios. Departing from conventional fixed-weight fusion, a lightweight coefficient generation network is trained to output query-conditioned fusion weights in real time, enabling weighted aggregation of multimodal similarity scores to retrieve the top-K most informative demonstrations. Prediction stability is further enhanced through majority voting over multiple candidate outputs generated by the MLLM. Extensive experiments on public benchmark datasets demonstrate that MAF achieves substantial and consistent performance improvements over the corresponding backbone variants and remains competitive with strong multimodal sentiment-analysis baselines.