Search papers, labs, and topics across Lattice.
AutoSynthesis is an innovative multi-agent system designed to automate the entire process of meta-analysis, from formulating search strategies to performing random-effects meta-analysis. By screening over 28 studies and extracting more than 20 quantitative claims, it demonstrated that its pooled effect estimates closely align with those generated by expert-conducted meta-analyses. This advancement not only enhances the scalability of quantitative evidence synthesis but also supports more efficient evidence-based decision-making across various fields.
AutoSynthesis achieves expert-level meta-analysis with automated precision, making evidence synthesis scalable and accessible.
Evidence synthesis is crucial for turning primary research into reliable knowledge for science, medicine, education, and policy. Yet, quantitative evidence synthesis remains largely manual and difficult to scale. Here, we introduce AutoSynthesis, an end-to-end multi-agent system for automated meta-analysis. Given a research question in natural language, AutoSynthesis formulates a search strategy, retrieves scientific literature, screens candidate studies, assesses full-text eligibility, extracts quantitative statistics, computes standardized effect sizes, and finally performs random-effects meta-analysis. AutoSynthesis further supports heterogeneity analysis to examine how effect sizes vary across moderators, as well as risk-of-bias assessment. As output, AutoSynthesis produces a transparent report aligned with PRISMA guidelines. In our application, AutoSynthesis screened over 28 studies and extracted more than 20 quantitative claims. The pooled effect estimates produced by AutoSynthesis are similar to Hedges'$g$ of expert-conducted meta-analyses, indicating close agreement with manual evidence synthesis. Together, these results show that AutoSynthesis can make quantitative evidence synthesis more scalable, thereby supporting evidence-based decision-making across disciplines.
MIT CSAIL