Search papers, labs, and topics across Lattice.
This paper explores a novel stealthy wear-out attack on Digital Twins (DTs) using Deep Reinforcement Learning (DRL) to manipulate control signals and induce accelerated wear on industrial systems. The study benchmarks various DRL algorithms, revealing that the Soft Actor-Critic (SAC) method outperforms others in sample efficiency and attack effectiveness, successfully increasing torque on a robotic arm joint while evading detection. The findings underscore the vulnerabilities of DT-enabled infrastructures and the urgent need for enhanced security measures against such covert adversarial tactics.
SAC-driven attacks can stealthily escalate maintenance costs in industrial systems by manipulating control signals without triggering detection.
Digital Twins (DTs) have emerged as pivotal enablers of Industry 4.0, offering transformative capabilities such as real-time monitoring, advanced simulation, and precise control of physical assets. By bridging the physical and virtual domains, DTs facilitate seamless integration of data-driven decision-making and operational optimisation. However, this seamless interaction significantly expands the attack surface of industrial systems, creating vulnerabilities that adversaries can exploit. This paper introduces a novel and stealthy wear-out attack leveraging Deep Reinforcement Learning (DRL) to target DT-enabled infrastructures. The adversary strategically and covertly manipulates control signals, inducing increased torque on a specific joint to accelerate wear and tear while evading detection by a state-of-the-art anomaly detection system. Extensive benchmarking of reinforcement learning algorithms - including Twin Delayed Deep Deterministic Policy Gradient (TD3), Soft Actor-Critic (SAC), Proximal Policy Optimisation (PPO), and Advantage Actor-Critic (A2C) - revealed that SAC consistently outperformed its counterparts in terms of sample efficiency, stability, and overall attack effectiveness. We evaluate the proposed adversary in an industrial setting using the UR10e robotic arm. Results demonstrate the adversary's ability to significantly elevate torque levels on the targeted joint, leading to accelerated degradation and increased maintenance costs, all while operating stealthily and avoiding detection. Our findings highlight the substantial risks posed by DRL-driven adversaries to DT-enabled environments and emphasise the critical need for robust defence mechanisms to protect critical industrial systems.
