Search papers, labs, and topics across Lattice.
Carnot is an interactive execution engine designed to enhance the querying of enterprise data lakes using natural language, addressing the limitations of existing AI-driven tools that operate as black boxes. By compiling natural language requests into physical execution graphs, Carnot allows users to critique, incrementally execute, and edit queries, thereby increasing transparency and control over the data retrieval process. The key result is that Carnot not only optimizes queries for cost and latency but also empowers analysts to verify and correct intermediate results, significantly improving the reliability of insights derived from complex data workloads.
Users can now interactively critique and optimize their AI-driven data queries, transforming opaque analytics into a transparent, controllable process.
Enterprises increasingly seek to query data lakes using natural language via AI-driven tools like semantic operators or deep research agents. However, the latter operates as an opaque black box, hiding its intermediate reasoning and data retrieval steps, and failing to expose controls for managing API costs and execution latency. Meanwhile, the former can be prohibitively expensive for enterprise-scale data lakes. Consequently, analysts using these systems lack the agency to intercept hallucinated premises, verify intermediate results, or correct the system's trajectory. We present Carnot, an interactive execution engine for AI-driven analytics. Carnot compiles natural language requests into physical execution graphs and surfaces them through an interactive notebook interface. Rather than waiting blindly for a final output, users can critique the plan, incrementally execute operators, inspect intermediate data, or directly edit the underlying code or semantic operator instructions. Carnot's query optimizer will optimize the query with respect to cost or latency constraints provided by the user. Our demo will showcase how Carnot helps users achieve efficient and verifiable insights on workloads motivated by real enterprise use cases.
