Search papers, labs, and topics across Lattice.
This paper investigates the vulnerabilities of Adaptive Transformer Trackers used in UAV tracking, revealing a critical flaw related to the Lipschitz singularity of their dynamic routing architecture. The authors demonstrate that minor input perturbations can lead to significant changes in the model's inference topology, creating a new attack surface that can be exploited. They introduce the Adversarial Path-Inversion (API) framework, which effectively manipulates gating decisions to disrupt the model's representation capability, achieving superior stealth and efficiency in attacks against state-of-the-art adaptive trackers.
Tiny input changes can destabilize UAV tracking models, revealing a new attack surface that undermines their efficiency and accuracy.
Resource constraints on UAV platforms have driven a paradigm shift in aerial tracking, from pursuing performance toward balancing accuracy with efficiency. Adaptive Transformer Trackers, which leverage an input-dependent dynamic routing architecture, have emerged as a representative solution to this challenge. However, we reveal that behind this computation-on-demand flexibility hides a critical structural flaw: the Lipschitz singularity of computational path decisions, which has an unbounded local Lipschitz constant at discrete layer-skipping decision boundaries. This mathematical discontinuity renders adaptive tracking networks inherently unstable: tiny input perturbations can be amplified at the gating modules, causing dramatic changes in the inference topology. We formally characterize this singularity in the context of adaptive tracking architectures and, for the first time, identify it as a directly exploitable new attack surface. This insight reveals a previously overlooked and highly vulnerable topological path space attack surface. Based on this, we propose the Adversarial Path-Inversion (API) framework. API generates imperceptible perturbations to precisely manipulate the gating decisions, forcing the inference onto altered computational paths. The severe inconsistency between the original and the inverted paths dismantles the representation capability of the model. Extensive experiments on state-of-the-art adaptive trackers demonstrate that API achieves superior perturbation stealthiness, more effective attack, and faster inference speeds. This work opens a new dimension for the security analysis of dynamic tracking networks and provides a theoretical warning for constructing robust adaptive tracking architectures in the future.
