Search papers, labs, and topics across Lattice.
This study explores how individuals utilize various sources of advice, including ChatGPT, human peers, and linguistic experts, in detecting AI-generated deepfake news. The findings reveal that participants tend to rely more on ChatGPT than on their peers when identifying GPT-2-generated deepfake content, although reliance on linguistic experts surpasses that on ChatGPT in a follow-up experiment conducted in 2025. The results underscore the importance of advice quality, indicating that effective AI tools can enhance detection outcomes when they provide high-quality guidance.
ChatGPT is preferred over human peers for detecting deepfake news, but linguistic experts still hold the edge in accuracy.
This experimental study investigates how people rely on different sources of advice when detecting AI-generated fake news (deepfake news). In a laboratory deepfake detection task, student participants identified the proportion of human-written (non-AI-generated) content in synthetic deepfake news articles and received advice from ChatGPT (GPT-4), human peers, or linguistic experts. The results show that participants rely more on ChatGPT than on human peers when detecting GPT-2-generated deepfake news. Participants also rely more on linguistic experts than on peers, while the relative reliance on experts versus ChatGPT is mixed across experimental waves, potentially reflecting time trends in beliefs about AI-based detection. Importantly, in the additional experiment conducted in 2025 under the same experimental procedure, participants relied more on linguistic experts than on ChatGPT. Moreover, performance improvements reflect the joint role of reliance and advice quality, arising primarily when participants rely on high-quality advice. Overall, relying on AI to detect AI-generated deepfakes can improve detection outcomes, but only when AI-based detection tools are of sufficiently high quality. These findings highlight the dual role of GAI as both a source of deepfakes and a tool for mitigating related risks.
