Search papers, labs, and topics across Lattice.
This paper introduces a standardized benchmarking framework to address inconsistencies in evaluating graph deep learning (GDL) models for in-silico toxicity prediction. By systematically comparing over 20 GDL approaches across multiple datasets and partitioning strategies under identical experimental conditions, the study provides a reliable assessment of current methods' strengths and limitations. The open-source release of the framework aims to foster transparency and reproducibility in this critical area of drug discovery.
Over 20 graph deep learning models for toxicity prediction reveal significant performance disparities and sensitivities to data partitioning, challenging prior claims of universal superiority.
Drug discovery is a costly and high-risk process, where toxicity-related failures remain a major cause of attrition in both preclinical and clinical stages. As a result, accurate early prediction of chemical toxicity is essential to reduce downstream costs and improve compound prioritization. In this context, graph deep learning (GDL) has emerged as a powerful paradigm for toxicity prediction, leveraging molecular graph representations to learn directly from chemical structure with improved expressivity over traditional approaches. Despite the growing number of proposed models, current literature-based comparisons are often difficult to interpret due to inconsistencies in datasets, preprocessing pipelines, and evaluation protocols. To address this limitation, we introduce a unified and standardized benchmarking framework for GDL-based toxicity prediction. We systematically evaluate more than 20 representative approaches under consistent experimental conditions and across multiple datasets and partitioning strategies, enabling a fair and reproducible comparison of model performance. In addition, we complement this empirical study with a structured literature analysis to contextualize existing methodological trends and performance claims. Our results provide a clearer and more reliable assessment of the current state of the field, highlighting both the strengths and limitations of existing graph-based approaches. To support transparency and reproducibility, we release our benchmarking framework as open-source software https://gitlab.citius.gal/noel.suarez/benchtox, allowing the community to evaluate and compare models under consistent conditions.