Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper categorizes 32 specific risks associated with automated fact-checking systems, particularly focusing on their potential to propagate misinformation on social networking services. By analyzing risk factors, hazardous situations, and resulting harm, the authors highlight the limitations of conventional IT security risk assessment methods like STRIDE in identifying these unique risks. The findings underscore the importance of developing a nuanced understanding of the risks involved in deploying AI-driven fact-checking systems to ensure their safe and effective use.
Automated fact-checking systems harbor 32 unique risks that traditional security assessments like STRIDE fail to capture, threatening the integrity of information on social media.
In recent years, the posting of fake news including disinformation and misinformation on social networking services (SNS) has become a social problem. To combat this fake news, fact-checking that is the process of assessing the veracity of posts on SNS has become increasingly important. While fact-checking is currently performed by fact-checking organizations, it is difficult to fact-check all posts on SNS. Therefore, the use of automated fact-checking systems is effective. Recent automated fact-checking systems utilize artificial intelligence and large language models, so there are risks of incorrect judgments and posting incorrect results on social media which can lead to the spread of misinformation or to engage in defamation. In this paper, as a first step toward enabling the safe use of automated fact-checking systems, we categorize the specific risks on automated fact-checking systems. In this categorizing, we consider a three-stage risk propagation: risk factors, hazardous situations, and harm. Our analysis revealed that 32 specific risks exist in automated fact-checking systems. In this paper, we utilize the categorized risks as analytical cues (guide words) to present the risk assessment of the automated fact-checking system DEFAME. This assessment result indicates that risks that cannot be derived using STRIDE, a conventional IT security risk assessment method can be derived using our guide words.