Search papers, labs, and topics across Lattice.
This paper introduces HandwritingAgent, a language-driven agent capable of synthesizing natural handwriting sequences in Scalable Vector Graphics (SVG) format without the constraints of style-specific training. By utilizing a large reasoning model, the agent generates handwritten glyphs as stroke sequences based on text prompts and reference images, allowing for flexible control over writing styles. Experimental results demonstrate that HandwritingAgent not only matches but often surpasses state-of-the-art generative handwriting models across various tasks, showcasing its efficiency and generalizability.
HandwritingAgent achieves superior handwriting synthesis by leveraging natural language prompts, eliminating the need for style-specific training while enhancing control and efficiency.
Teaching machines to emulate natural handwriting styles remains an open challenge, as it requires synthesizing stroke sequences that dynamically vary in shape, texture, pressure and script - not only across individuals, but also within a single person's handwriting. Attempts at this challenge have largely explored deep learning methods in both online and offline settings. However, these approaches are often constrained by style-specific architectural choices, heavy reliance on large datasets, high compute costs, and a lack of flexible control over writing styles through natural language. To this end, we introduce HandwritingAgent, a language-driven agent that can synthesize natural handwriting sequences directly in Scalable Vector Graphics (SVG) format with no need for style-specific training. The agent leverages a large reasoning model to geometrically analyse and autoregressively generate target handwritten glyphs as stroke sequences in a discrete grid canvas environment. Generation is conditioned on texts provided in either conversational or non-conversational mode, along with a reference handwriting-style image. Experiments on diverse handwriting tasks spanning imitation, recognition, multi-lingual handwriting synthesis, and generation of complex handwritten maths and science expressions indicate substantial improvement in performance, with HandwritingAgent matching or surpassing state-of-the-art generative handwriting models, while providing a more efficient, controllable, and generalizable synthesis method.
