Search papers, labs, and topics across Lattice.
This paper introduces DiffMath, a novel framework for Handwritten Mathematical Expression Generation (HMEG) that utilizes a symbol- and graph-aware latent diffusion approach to overcome the limitations of existing methods reliant on costly spatial supervision. By employing a Relational Abstract Syntax Tree (RelAST) to represent mathematical structures and integrating a MathVAE for learning structure-preserving latent representations, DiffMath eliminates the need for positional annotations while maintaining semantic and spatial integrity. Experimental results demonstrate that DiffMath not only generates structurally consistent handwritten expressions but also enhances the performance of downstream OCR models through effective synthetic data augmentation.
DiffMath achieves superior handwritten mathematical expression generation without costly spatial supervision, leveraging a novel latent diffusion approach that enhances both structure and accuracy.
Handwritten Mathematical Expression Generation (HMEG) is challenging due to the complex two-dimensional layouts and long-range structural dependencies of mathematical expressions. Existing methods typically rely on explicit spatial supervision, such as symbol-level bounding boxes, which incurs high annotation costs and limits scalability. In this work, we propose DiffMath, a symbol- and graph-aware latent diffusion framework that leverages the hierarchical structure inherent in LaTeX as a structural prior, eliminating the need for positional supervision. First, we design a Relational Abstract Syntax Tree (RelAST), a generation-oriented representation that distills MathML trees into compact triplet sequences [S, R, D], where each token directly encodes a symbol identity, spatial relation, or nesting depth. Second, we introduce MathVAE, which learns structure-preserving latent representations through symbol-aware and relation-aware perceptual regularization, ensuring that the latent space captures both character semantics and spatial topology. Third, MathDiT performs conditional denoising in this structured latent space, further guided by a global symbol-count prior via Adaptive Layer Normalization (AdaLN) to improve structural coherence. Experiments show that DiffMath produces structurally consistent handwritten expressions, achieves superior performance over existing methods, and improves the accuracy of downstream OCR models through synthetic data augmentation.
