Search papers, labs, and topics across Lattice.
This study explores the effects of synthetic data augmentation on discourse-pragmatic function classification, emphasizing the geometric relationship of synthetic examples to real training data rather than merely their quantity. By generating synthetic instances with Llama 3.1 and analyzing their placement in RoBERTa embedding space, the authors find that strategically positioned synthetic examples can significantly enhance model performance, with core proximal examples yielding the highest macro F score improvement of 0.113. However, while accuracy improved, no augmentation condition enhanced the AUC, indicating that the synthetic data primarily shifts the decision boundary rather than refining probability estimates.
Placement of synthetic data in representation space can be more crucial than sheer volume, leading to significant performance gains in low-resource NLP tasks.
Synthetic data augmentation has become a common strategy for addressing class imbalance in NLP, but most approaches focus on the quantity and diversity of generated examples rather than their geometric relationship to real training data. We investigate this question in the context of discourse pragmatic function classification, a task where data sparsity is a structural feature rather than a collection artefact. Using 410 manually annotated instances of the English word look drawn from the British National Corpus, spanning four functions: Attention Signal, Directive, Discourse Marker, and Interjection. We generate synthetic training examples with Llama 3.1 and partition them by their cosine distance from real training data in RoBERTa embedding space. We compare six training conditions that differ in the placement of synthetic examples relative to the empirical decision boundary, while holding augmentation quantity constant across conditions. All augmented conditions improve macro F and accuracy over the real only baseline, but core proximal examples (NEAR) yield the largest gains in macro F (0.113), while a distance balanced mix achieves the highest accuracy (0.748). No condition improves AUC, indicating that augmentation shifts the decision boundary rather than improving the model's underlying probability estimates. These findings suggest that where synthetic examples land in representation space matters as much as how many are generated, with implications for low resource pragmatic classification more broadly.
