Search papers, labs, and topics across Lattice.
This paper introduces SPG (Structure-aware Patent Generation), a novel approach for generating patent claims that addresses the hierarchical constraints inherent in patent language by predicting claim topology during the autoregressive generation process. By utilizing a pointer mechanism to select parent claims and incorporating a depth-adaptive scope regularizer, the model effectively reshapes the decoder's representations, leading to improved coherence and consistency in generated claims. The results show that SPG achieves a remarkable 79.0% recovery of gold parent links and significantly enhances antecedent consistency compared to a supervised baseline, as validated by expert evaluation.
SPG recovers 79% of gold parent links in patent claims, revealing a new way to enforce hierarchical dependencies in autoregressive generation.
Autoregressive decoders emit flat token sequences and cannot enforce hierarchical constraints across output segments, a limitation that becomes acute in patent claim generation, where a claim set forms a dependency forest whose scope must narrow monotonically with depth. Topology and content are mutually dependent: a dependent claim's wording must reflect its parent's scope, yet the parent must be chosen before that wording exists, so neither post-hoc parsing nor grammar-constrained decoding suffices. We propose SPG (Structure-aware Patent Generation), which predicts topology inside the autoregressive pass. A pointer head selects each dependent claim's parent, and its gradients, together with a depth-adaptive scope regularizer, reshape the shared decoder's representations during training. A second stage then applies a violation-weighted preference objective over self-generated deficient candidates, supplying the negative signal that granted-patent corpora lack. On HUPD-DCG, SPG on Llama-3-8B-Instruct recovers 79.0\% of gold parent links, a quantity its training reward never supervises, and raises antecedent consistency from 0.292 to 0.478 over a supervised baseline of equal scale, with expert evaluation corroborating these gains.
