Search papers, labs, and topics across Lattice.
This study benchmarked five LLMs (ChatGPT-4o, Grok3.0, Claude4Sonnet, Gemini2.5 Flash, DeepSeekR1) on their ability to generate accurate, readable, and high-quality responses to frequently asked questions about body donation in Turkish. ChatGPT-4o and Grok3.0 significantly outperformed the other models in terms of quality and readability, achieving scores indicating below-secondary-school reading levels. The findings suggest LLMs can assist in creating accessible and reliable informational materials about body donation, but ethical considerations and human oversight are crucial.
ChatGPT-4o and Grok3.0 ace body donation FAQs in Turkish, proving LLMs can draft sensitive informational texts, but ethical guardrails are a must.
Educational materials advocating whole‐body donation must be accurate, easy to read, and transparent, as one potential solution to the fact that the supply of donations is not keeping pace with educational demand, thereby disrupting anatomy education programs. The use of AI technologies to supplement communications with prospective donors and next of kin deserves investigation to determine whether LLM‐based approaches meet the common requirements for effective communication. This study contributes to the limited literature on LLM‐supported communications by presenting a comparative quantitative benchmark and an adaptable evaluation framework. Five LLMs (ChatGPT‐4o, Grok3.0, Claude4Sonnet, Gemini2.5 Flash, DeepSeekR1) were used to generate responses to six frequently asked questions about body donation in Turkish. Four anatomists evaluated accuracy, quality, readability, and vocabulary diversity. Differences between models were statistically analyzed. The two top‐performing models, ChatGPT‐4o and Grok3.0, achieved mean quality scores of 21.7 ± 2.8 and 21.0 ± 5.1 on a 25‐point checklist, and 4.58 ± 0.88 and 4.25 ± 1.03 on a 5‐point global quality scale, significantly outperforming the remaining three systems (p < 0.037). Both maintained a below‐secondary‐school level on two validated readability indices (scores ≥67.8 and ≥40.2). LLM‐produced body donation materials (e.g., informational texts and FAQs) may help promote the importance of whole‐body donations by providing accessible and reliable information, potentially streamlining the creation of first drafts and reducing staff workload. Given the sensitivity of donation decisions, ethical transparency, cultural sensitivity, and continuous human oversight are essential safeguards. Therefore, LLM use for such purposes should be governed by clear governance frameworks, regular expert audits, and publicly disclosed quality metrics.