Search papers, labs, and topics across Lattice.
The paper introduces ViX-Ray, a new dataset of 5,400 Vietnamese chest X-ray images paired with physician-written findings and impressions, designed to address the lack of Vietnamese medical data for vision-language models (VLMs). Linguistic analysis of the dataset reveals domain-specific characteristics of Vietnamese radiology reports. Fine-tuning experiments with open-source VLMs demonstrate that while models show partial alignment with clinical ground truths, they struggle with low precision and hallucination, particularly in impression generation, highlighting the dataset's complexity and its value as a benchmark.
VLMs stumble when diagnosing Vietnamese chest X-rays, revealing a critical gap in their ability to handle diverse medical data and underscoring the need for datasets like ViX-Ray.
Vietnamese medical research has become an increasingly vital domain, particularly with the rise of intelligent technologies aimed at reducing time and resource burdens in clinical diagnosis. Recent advances in vision-language models (VLMs), such as Gemini and GPT-4V, have sparked a growing interest in applying AI to healthcare. However, most existing VLMs lack exposure to Vietnamese medical data, limiting their ability to generate accurate and contextually appropriate diagnostic outputs for Vietnamese patients. To address this challenge, we introduce ViX-Ray, a novel dataset comprising 5,400 Vietnamese chest X-ray images annotated with expert-written findings and impressions from physicians at a major Vietnamese hospital. We analyze linguistic patterns within the dataset, including the frequency of mentioned body parts and diagnoses, to identify domain-specific linguistic characteristics of Vietnamese radiology reports. Furthermore, we fine-tune five state-of-the-art open-source VLMs on ViX-Ray and compare their performance to leading proprietary models, GPT-4V and Gemini. Our results show that while several models generate outputs partially aligned with clinical ground truths, they often suffer from low precision and excessive hallucination, especially in impression generation. These findings not only demonstrate the complexity and challenge of our dataset but also establish ViX-Ray as a valuable benchmark for evaluating and advancing vision-language models in the Vietnamese clinical domain.
