Search papers, labs, and topics across Lattice.
This paper introduces a synthetic data generation pipeline using backtranslation and fine-tuned models to create a large dataset of French social media posts for customer distress detection. The generated data includes synthetic reasoning traces, enabling the training of 600M-parameter models that achieve 77-79% accuracy on human-annotated data. The results demonstrate that synthetic data can match or exceed the performance of SOTA proprietary LLMs and specialized encoders while addressing data scarcity, annotation costs, and privacy concerns.
Forget expensive data annotation: this pipeline generates synthetic social media data that trains models to SOTA performance, all while preserving user privacy.
Automated analysis of customer feedback on social media is hindered by three challenges: the high cost of annotated training data, the scarcity of evaluation sets, especially in multilingual settings, and privacy concerns that prevent data sharing and reproducibility. We address these issues by developing a generalizable synthetic data generation pipeline applied to a case study on customer distress detection in French public transportation. Our approach utilizes backtranslation with fine-tuned models to generate 1.7 million synthetic tweets from a small seed corpus, complemented by synthetic reasoning traces. We train 600M-parameter reasoners with English and French reasoning that achieve 77-79% accuracy on human-annotated evaluation data, matching or exceeding SOTA proprietary LLMs and specialized encoders. Beyond reducing annotation costs, our pipeline preserves privacy by eliminating the exposure of sensitive user data. Our methodology can be adopted for other use cases and languages.
