Search papers, labs, and topics across Lattice.
This paper introduces Data Intelligence Agents (DIA), a system comprising three autonomous coding agents that streamline the production data integration process by generating, executing, validating, and repairing data artifacts. By leveraging a shared memory for experience reuse, DIA significantly reduces the inefficiencies caused by traditional handoffs among data stakeholders. The Query Generator, a core component of DIA, achieves state-of-the-art performance across seven SQL benchmarks, highlighting the effectiveness of an execution-grounded architecture in enhancing data intelligence workflows.
Autonomous coding agents can outperform traditional methods in data integration tasks, achieving top results across multiple SQL benchmarks.
Production data integration is bottlenecked by repeated, lossy handoffs between data owners, engineers, and analysts who must collaboratively discover, structure, and query enterprise data. We present Data Intelligence Agents (DIA), a system of three agents (Data Interpreter, Schema Creator, and Query Generator) that compresses this workflow by treating autonomous coding agents (ACAs) as a first-class abstraction: rather than emitting text, the agents generate, execute, validate, and repair concrete artifacts, draw on a shared memory for experience reuse, and surface each for review by domain experts. DIA is deployed in production for enterprise customers. We study the Query Generator in depth and evaluate it in fully autonomous mode across seven SQL benchmarks spanning four task categories and four dialects. It matches or surpasses the best published results on all seven, demonstrating that an architecture grounded in execution, built on ACAs and a shared memory, generalizes across the data intelligence workload with adaptation confined to natural-language instructions.
