Search papers, labs, and topics across Lattice.
Peerispect is an interactive system developed to enhance the verification of claims made in scientific peer reviews by extracting check-worthy statements, retrieving relevant evidence from manuscripts, and employing natural language inference for validation. This tool addresses the critical issue of subjective and misaligned claims in peer reviews, which can undermine the integrity of scientific publishing. The modular design of Peerispect allows for flexibility in its information retrieval components, making it a valuable resource for reviewers, authors, and program committees alike.
Claim verification in peer reviews just got a major upgrade with Peerispect, a tool that highlights evidence directly in manuscripts for rapid assessment.
Peer review is central to scientific publishing, yet reviewers frequently include claims that are subjective, rhetorical, or misaligned with the submitted work. Assessing whether review statements are factual and verifiable is crucial for fairness and accountability. At the scale of modern conferences and journals, manually inspecting the grounding of such claims is infeasible. We present Peerispect, an interactive system that operationalizes claim-level verification in peer reviews by extracting check-worthy claims from peer reviews, retrieving relevant evidence from the manuscript, and verifying the claims through natural language inference. Results are presented through a visual interface that highlights evidence directly in the paper, enabling rapid inspection and interpretation. Peerispect is designed as a modular Information Retrieval (IR) pipeline, supporting alternative retrievers, rerankers, and verifiers, and is intended for use by reviewers, authors, and program committees. We demonstrate Peerispect through a live, publicly available demo (https://app.reviewer.ly/app/peerispect) and API services (https://github.com/Reviewerly-Inc/Peerispect), accompanied by a video tutorial (https://www.youtube.com/watch?v=pc9RkvkUh14).
BAIR