Search papers, labs, and topics across Lattice.
This paper investigates data-only poisoning attacks against protein design systems, specifically targeting pre-training corpora for autoregressive models and retrieval corpora for text-guided generators. The authors demonstrate that introducing poisoned protein sequences during pre-training can lead to reliable trigger-dependent generation in models like ProtGPT2 and ProGen2, with early activation observed even with limited poisoned data. Furthermore, inserting poisoned records into retrieval systems can significantly alter generated sequences, with some acquiring specific inserted domains, highlighting the vulnerability of these systems to adversarial data manipulation.
Adversarial data poisoning can hijack protein design models, forcing them to generate specific, unintended protein sequences with remarkable reliability, even when the model's core weights remain untouched.
Protein foundation models increasingly support the generation of novel biological sequences, yet their reliance on large public datasets creates opportunities for adversarial manipulation of the material they learn from and retrieve. We investigate two data-only poisoning attacks against protein design systems, targeting the pre-training corpus of autoregressive protein language models and the retrieval corpus of a text-guided protein generator. For the first, we pre-trained ProtGPT2 and ProGen2 variants of 300 million parameters, introducing poisoned protein sequences containing one of two triggers followed by one of three payloads. Across all poisoned runs, both architectures acquired highly reliable trigger-dependent generation under uniform and ramped poisoning schedules. Under ramped exposure, the earliest majority activation occurred after only 200 contaminated examples, while for the uniform schedule earliest activation occurred around 5000 poisoned samples. For the second attack, we inserted records into a retrieval corpus system without modifying its weights or decoding procedure. A single query-aware record captured a top-16 retrieval position for 58\% of templated requests and 97\% of free-text requests. Conditional on successful poisoned retrieval, 62\% of requests produced altered sequences, while 19-21% acquired the inserted domain by profile-HMM homology. A universal query-unaware attack using 1,500 records also achieved substantial retrieval capture and domain transfer. Together, these findings demonstrate that adversarial protein sequence contributions can establish persistent, sequence-specific behaviour during pre-training or redirect protein generation at inference, while leaving ordinary model behaviour largely preserved. Our work establishes the integrity and biological provenance of protein sequence data as critical safeguards for generative protein design systems.