Search papers, labs, and topics across Lattice.
This paper introduces a novel adversarial attack framework specifically designed for online handwriting recognition, leveraging salience-guided temporal editing to manipulate pen trajectory data. By inserting and deleting points based on temporal salience, the method maintains the visual integrity of the handwriting while effectively generating adversarial examples. Experimental evaluations reveal that this approach significantly enhances transferability in one-shot black-box settings compared to conventional image-based adversarial methods, highlighting a critical vulnerability in handwriting recognition systems.
Temporal editing can exploit vulnerabilities in handwriting recognition systems more effectively than traditional image-based adversarial attacks, achieving superior transferability with minimal visual distortion.
Deep learning models for online handwriting recognition have been shown effective and are increasingly deployed in practical applications. However, their vulnerability to adversarial attacks is still a challenge. Existing adversarial methods are predominantly designed for image-based inputs and typically rely on additive spatial perturbations. When applied to online handwriting, which is inherently represented as a time series of pen trajectories, such perturbations often introduce high-frequency jitter and visibly unnatural stroke artifacts. In this work, we propose a novel adversarial attack framework for online handwriting recognition based on salience-guided temporal editing. Instead of adding noise, the proposed method generates adversarial examples by inserting and deleting points at time steps selected according to temporal salience, preserving the shape and smoothness of the original handwriting. Temporal salience is estimated using gradient-based activation mapping, which guides edits toward time steps that strongly support the original class prediction. We evaluate the proposed approach on the Unipen and CASIA-OLHWDB datasets under both white-box and one-shot black-box attack settings. Experimental results demonstrate that while conventional image-based attacks achieve strong white-box performance, they exhibit poor transferability across models. In contrast, the proposed temporal editing attack achieves stronger one-shot black-box transferability while preserving the visual structure of the handwriting. These results indicate that temporal editing is a relevant threat model for online handwriting recognition, particularly in one-shot black-box transfer settings.
