Search papers, labs, and topics across Lattice.
This report introduces Invent-A-Dataset, a prompt-based system for generating large-scale, realistic post-training datasets from textual descriptions in a zero-data regime. Evaluating against five frontier model APIs across eight task types and up to 20K samples, Invent-A-Dataset achieves significant relative gains of 17% in quality and 19% in diversity. This approach translates to demonstrably more performant downstream fine-tuned models, consistently outranking other generative methods.
Generating high-quality, diverse datasets from scratch is now possible, outperforming frontier models by 17% in quality and 19% in diversity.
Building datasets remains one of the most manual and brittle parts of AI development. In this technical report, we focus on the most extreme but also most prevalent setting real world practitioners face: a zero data regime. Here, practitioners don't have any data for the capability they want to learn. We introduce Invent-A-Dataset which is a prompt based system to go from dataset description to realistic and large scale post-training datasets. We evaluate Invent-A-Dataset against five frontier model APIs including Anthropic, Google, Open AI, DeepSeek, Zai. Across eight task types and dataset sizes up to 20K samples, Invent-A-Dataset significantly outperforms with both the highest quality (17% relative gains) while simultaneously producing the most diverse samples (19% relative gains). Its diversity advantage widens with scale of training dataset size (from parity at 200 samples to 37% relative gains at 20K samples). This translates into considerable downstream training gains, resulting in far more performant post-trained models. Invent-A-Dataset fine-tune consistently ranks higher compared to other generator fine-tunes across different post-trained model architectures.