Search papers, labs, and topics across Lattice.
The paper introduces Airavat, an agentic framework that automates the generation and verification of Internet measurement workflows. Airavat employs multiple agents for problem decomposition, solution design, and code implementation, guided by a registry of existing tools. A verification engine using a knowledge graph of measurement research and a validation engine ensure methodological correctness, demonstrated through case studies that show Airavat can match expert solutions and identify flaws missed by standard testing.
Airavat automates expert-level Internet measurement, catching methodological flaws that traditional testing misses.
Internet measurement faces twin challenges: complex analyses require expert-level orchestration of tools, yet even syntactically correct implementations can have methodological flaws and can be difficult to verify. Democratizing measurement capabilities thus demands automating both workflow generation and verification against methodological standards established through decades of research. We present Airavat, the first agentic framework for Internet measurement workflow generation with systematic verification and validation. Airavat coordinates a set of agents mirroring expert reasoning: three agents handle problem decomposition, solution design, and code implementation, with assistance from a registry of existing tools. Two specialized engines ensure methodological correctness: a Verification Engine evaluates workflows against a knowledge graph encoding five decades of measurement research, while a Validation Engine identifies appropriate validation techniques grounded in established methodologies. Through four Internet measurement case studies, we demonstrate that Airavat (i) generates workflows matching expert-level solutions, (ii) makes sound architectural decisions, (iii) addresses novel problems without ground truth, and (iv) identifies methodological flaws missed by standard execution-based testing.
Stanford HAI