Search papers, labs, and topics across Lattice.
This study systematically investigates how input dimensionality influences the emergence and targeted control of adversarial examples in deep neural networks. By analyzing existing theoretical frameworks and conducting extensive empirical evaluations across various datasets and architectures, the authors reveal that higher dimensionality facilitates the construction of adversarial examples and narrows the gap between targeted and untargeted attacks. The findings underscore the importance of input dimensionality as a critical factor in understanding adversarial vulnerability, while leaving open questions about the underlying mechanisms at play.
Adversarial examples become significantly easier to generate as input dimensionality increases, challenging existing theoretical assumptions about their emergence.
Several theoretical works have tried to explain the adversarial vulnerability of deep neural networks through properties of high-dimensional geometry. However, the assumptions underlying these works are rarely examined empirically, and systematic evidence remains limited. In this work, we present a systematic study of the role of input dimensionality in both the emergence and the targeted control of adversarial examples. We first analyse the scope and limitations of existing theoretical frameworks based on concentration of measure, showing that real image classes exhibit strong empirical localization, beyond what such theories typically assume. We then conduct an extensive empirical evaluation across hierarchical image datasets spanning a wide range of input dimensionalities and diverse neural architectures. Our results consistently show that adversarial examples become easier to construct as dimensionality increases. We also investigate how input dimensionality affects the additional difficulty of crafting targeted adversarial examples. In particular, we provide theoretical arguments showing that high-dimensional geometry implies that enforcing a specific target label entails only a limited additional distortion compared to untargeted attacks. We corroborate this insight through extensive experiments, demonstrating that the gap between targeted and untargeted perturbations remains small and further narrows as input dimensionality increases. While, taken together, our findings establish high input dimensionality as a fundamental factor underlying the emergence and targeted control of adversarial examples, whether this phenomenon primarily arises from the interplay between high-dimensional geometry and data distributions or from the architectural properties of deep neural networks remains an open question.
