Search papers, labs, and topics across Lattice.
The authors introduce FMMD, a new multimodal dataset for automated scholarly paper review (ASPR) sourced from F1000Research, addressing limitations of existing text-centric and computer science-focused datasets. FMMD includes manuscript-level visual and structural data, version-specific reviewer reports, and editorial decisions, enabling analysis of the peer review lifecycle. The dataset facilitates tasks like multimodal issue detection and review comment generation, offering a valuable resource for advancing ASPR research across diverse scientific domains.
Finally, a dataset that moves beyond text-centric peer review to capture the rich visual and iterative nature of manuscript evaluation.
Automated scholarly paper review (ASPR) has entered the coexistence phase with traditional peer review, where artificial intelligence (AI) systems are increasingly incorporated into real-world manuscript evaluation. In parallel, research on automated and AI-assisted peer review has proliferated. Despite this momentum, empirical progress remains constrained by several critical limitations in existing datasets. While reviewers routinely evaluate figures, tables, and complex layouts to assess scientific claims, most existing datasets remain overwhelmingly text-centric. This bias is reinforced by a narrow focus on data from computer science venues. Furthermore, these datasets lack precise alignment between reviewer comments and specific manuscript versions, obscuring the iterative relationship between peer review and manuscript evolution. In response, we introduce FMMD, a multimodal and multidisciplinary open peer review dataset curated from F1000Research. The dataset bridges the current gap by integrating manuscript-level visual and structural data with version-specific reviewer reports and editorial decisions. By providing explicit alignment between reviewer comments and the exact article iteration under review, FMMD enables fine-grained analysis of the peer review lifecycle across diverse scientific domains. FMMD supports tasks such as multimodal issue detection and multimodal review comment generation. It provides a comprehensive empirical resource for the development of peer review research.
