Search papers, labs, and topics across Lattice.
The authors develop EmoMed, a multimodal medical agent that infers patient emotional states鈥攕pecifically anxiety, confusion, and urgency鈥攆rom text and clinical imagery to dynamically modulate response tone, structure, and depth. To prevent affective adaptation from degrading diagnostic precision, the architecture couples emotional steering with a dual-retrieval pipeline spanning live web search and an API-connected medical knowledge base. Evaluated across seven frontier foundation models and a controlled user study, affective conditioning consistently outperformed neutral baselines across MedQA-style benchmarks, safety metrics, and human trust ratings without sacrificing factual accuracy.
Medical LLMs do not need to trade diagnostic rigor for bedside manner: conditioning generation on inferred patient affect consistently beats neutral baselines on both human clarity ratings and objective clinical benchmarks.
We present EmoMed - a multimodal medical consultation agent that adapts its responses based on users' emotional states while maintaining clinical accuracy. The system processes text and medical images, detects affect indicators (anxiety, confusion, urgency) from user input, and adjusts response tone, structure, and detail level accordingly. To ensure factual reliability, the agent grounds clinical information through a dual retrieval mechanism: web-based fact-checking and an API-connected, continuously updated medical knowledge base. We evaluate our approach across seven state-of-the-art language models (GPT-4/5, Qwen3, Llama 4, Gemini 2.5, Grok4, Claude3) using comprehensive metrics including LLM-as-judge assessments, MedQA style accuracy tests, BERT Score, safety/helpfulness ratings, and multimodal medical benchmarks. The results demonstrate that emotionally adaptive responses consistently outperform neutral baseline across evaluation dimensions, without compromising clinical accuracy. A controlled user study validated these findings, with participants reporting improved perceived empathy and communication clarity, while maintaining trust in factual accuracy. Source code: https://github.com/NasonovIvan/EmoMed-Agent
