Search papers, labs, and topics across Lattice.
This paper investigates the susceptibility of LLMs to manipulation by fringe scientific theories. Custom LLMs were trained to prioritize fringe papers on the Fine Structure Constant and Gravitational Waves, and their responses were compared to those of domain experts and standard LLMs. Results showed the manipulated LLMs generated fluent but scientifically inaccurate responses, highlighting a vulnerability to misinformation that is difficult for non-experts to detect.
LLMs can be easily manipulated to confidently disseminate fringe scientific theories, even when those theories contradict established scientific consensus.
This paper is under review in AI and Ethics This study examines whether large language models (LLMs) can reliably answer scientific questions and demonstrates how easily they can be influenced by fringe scientific material. The authors modified custom LLMs to prioritise knowledge in selected fringe papers on the Fine Structure Constant and Gravitational Waves, then compared their responses with those of domain experts and standard LLMs. The altered models produced fluent, convincing answers that contradicted scientific consensus and were difficult for non-experts to detect as misleading. The results show that LLMs are vulnerable to manipulation and cannot replace expert judgment, highlighting risks for public understanding of science and the potential spread of misinformation.
