Search papers, labs, and topics across Lattice.
The authors systematically audited technical and study biases across major protein-protein interaction (PPI) databases鈥攊ncluding HIPPIE, IntAct, STRING, and PDB-derived structures鈥攖o identify non-biological shortcuts exploited by ML models. They found that standard random splitting creates pervasive topological artifacts, while removing train-test protein overlap still leaves subtle shortcuts in self-interaction, taxonomy, and functional relatedness that conventional negative sampling can paradoxically amplify. To resolve this, they provide an integer linear programming framework that jointly optimizes similarity-aware dataset splitting and bias-minimizing negative sampling.
Even "leak-free" protein interaction benchmarks are riddled with non-biological shortcuts that models readily exploit鈥攁nd standard negative-sampling heuristics often make the bias worse.
Protein-protein interaction (PPI) databases do not faithfully reflect biological realities. Instead, they are influenced by study and technical biases that distort certain protein and interaction attributes. Machine learning models can exploit these as learning shortcuts if the negative dataset is not constructed with care. So far, the shortcuts introduced during PPI dataset construction have only been examined in isolation. Here, we systematically characterize both reported and, to our knowledge, previously unreported biases in PPI datasets that lead machine learning models to learn shortcuts instead of biological signal. We analyze HIPPIE, IntAct, and STRING, dedicated PPI databases, as well as two datasets derived from 3D-structural information in the Protein Data Bank (PDB). We show that random data splitting introduces strong topological shortcuts. When train-test protein overlap is removed, the resulting datasets still retain usable shortcuts stemming from self-interactions, taxonomic identity, and functional relatedness, whose prevalence interestingly depends on the data source. We further show that sampling negatives from a set of high-confidence non-interactors, an intuitively appealing choice, can amplify the shortcut stemming from functional relatedness. To detect and mitigate these biases, we provide an open Nextflow pipeline that combines similarity-aware, data-loss-minimizing dataset splitting with bias-minimizing negative sampling, both formulated as integer linear programs. Its key concept of quantifying biases to minimize them through optimization-based negative sampling can, in principle, be extended to any machine learning problem where the pool of negative candidates is much larger than the positives and is thus of interest also beyond PPI prediction.
