Search papers, labs, and topics across Lattice.
This paper introduces UniTexture, a novel adversarial attack that exploits cross-task vulnerabilities in Vision-Language-Action (VLA) models by utilizing a single textured 3D object to induce significant deviations in action predictions across multiple tasks. By backpropagating gradients through a differentiable renderer, UniTexture optimizes texture parameters to steer actions toward attacker-defined targets without needing separate textures for each task. The evaluation shows that UniTexture can drastically reduce task success rates from 90.0% to 48.4% under attack, highlighting a critical security concern in multitask robotic systems.
A single adversarial texture can compromise the performance of Vision-Language-Action models across multiple tasks, revealing alarming shared vulnerabilities.
Vision-Language-Action (VLA) models have emerged as generalist robotic policies capable of following diverse language instructions and performing a wide range of manipulation tasks. However, their direct control over embodied agents also exposes them to adversarial interference that may cause unsafe physical behaviors. Existing attacks on robotic policies are typically optimized for a single task or instruction, leaving the cross-task vulnerabilities of multitask VLAs largely unexplored. We introduce UniTexture, a cross-task universal adversarial texture attack that uses a single textured 3D object to induce targeted deviations in VLA action predictions across multiple tasks. UniTexture backpropagates gradients from the policy's action outputs to surface texture parameters through a differentiable renderer. It jointly optimizes the shared texture over a distribution of tasks, instructions, states, and viewpoints using a targeted action-space objective, steering predicted actions toward attacker-defined targets without optimizing a separate texture for each task. We evaluate UniTexture on OpenVLA and $\pi_{0.5}$ across diverse manipulation tasks and multiple evaluation settings. UniTexture reduces the mean task success rate from 90.0% under benign conditions to 48.4% under attack, induces target-aligned action shifts, and further exhibits cross-suite and cross-model transfer without re-optimization. Together, these findings reveal shared cross-task vulnerabilities in multitask VLAs that can be systematically exploited through a single adversarial surface texture.
