Search papers, labs, and topics across Lattice.
This study identifies and analyzes "statistical adversaries" in vision datasets, which are naturally occurring signals that mimic backdoor triggers without malicious intent. By examining Imagenet, the authors reveal that these signals can significantly influence model predictions and are more targeted than typical corruptions, transferring effectively across various model architectures. The findings highlight that vulnerabilities in models may stem from dataset structures rather than solely from model-specific issues, emphasizing the need for thorough dataset audits to uncover these latent attack surfaces.
Ordinary datasets may harbor exploitable adversarial features that can undermine model predictions, even without intentional poisoning.
Model-specific adversarial attacks have been extensively studied. We study a different failure mode: naturally occurring statistical signals in vision data that can behave like backdoor-like triggers without being maliciously inserted. We call these signals statistical adversaries. We analyse Imagenet to find patterns that are strongly linked to certain labels. We then use statistical controls to remove random correlations from our candidate signals. Finally, we demonstrate that these signals directly and predictably alter model predictions. These statistical adversaries are more targeted than generic corruptions and transfer across different model architectures. This suggests that some vulnerabilities are driven by dataset structure and distribution rather than a single model's idiosyncrasies. We conclude that ordinary datasets can contain exploitable adversarial surfaces even in the absence of poisoning, and suggest that dataset audits should treat spurious structure not only as a source of bias or interpretability failure, but also as a latent attack surface for vision models.
