Search papers, labs, and topics across Lattice.
This paper introduces the Domain Credibility Evaluation Framework (DCEF), which leverages temporal article-level credibility signals to assess the credibility of web domains without prior knowledge of their reputation. By mimicking the workflow of expert fact-checkers, DCEF addresses the challenge of evaluating newly emerging domains that lack established credibility. The key finding reveals that DCEF effectively predicts domain credibility by analyzing the content of articles, highlighting the potential for automated systems to combat misinformation in real-time.
Evaluating the credibility of new web domains using article-level signals could revolutionize how we combat misinformation online.
Web domain credibility evaluation is vital for combating misinformation. It is conducted by examining factors such as domain type, transparency, and overall reputation. However, assessing the credibility of newly emerging web domains remains challenging since they have no reputation yet. Expert fact-checkers evaluate the credibility of domains by analyzing the content of their articles, including the presence of misinformation, bias, or propaganda. Yet, the ease of large-scale content generation enabled by LLMs has accelerated the creation of new content, rendering manual assessment insufficient and underscoring the need for automated approaches to domain credibility evaluation. In this paper, we introduce our Domain Credibility Evaluation Framework (DCEF), a temporal framework for domain credibility evaluation grounded in expert ratings. DCEF enables us to investigate whether the credibility of web domains can be assessed from their published articles following the workflow of expert fact-checkers, without any prior knowledge of the source domains themselves.
