Search papers, labs, and topics across Lattice.
This paper introduces Agon, an autonomous research orchestrator that leverages large language models to streamline the research process by validating claims within a defined workflow. By applying six design principles, Agon was tested across various domains through 444 iterations of Prompt Economy loops, revealing both its scalability and new categories of failure. The findings culminate in a taxonomy of failures that distinguishes between those manageable by the system and those necessitating human intervention, indicating a shift toward a collaborative paradigm of machine-assisted research.
Agon reveals that machine-driven research can scale effectively while exposing critical failure modes that still require human oversight.
Large language models are making research production scalable, shifting the bottleneck from producing artifacts to judging claims. We present \textsc{Agon}, a research orchestrator that validates what can be checked inside the workflow and leaves the remaining judgments to human scientists. \textsc{Agon} is built on six design principles: Prompt Economy, Future-Facing, Minimal Prompts, OmniDisciplinary, Massive Parallelism, and Zero-Code. We ran \textsc{Agon} across domains for 444 iterations of Prompt Economy loops, using only small starting topics and no human-written experimental code. These deployments demonstrate scalability while exposing new classes of failure. We organize these failures into a taxonomy along severity, fixability, visibility, and capability locus. The taxonomy separates failures the loops can see and fix from those that require human judgment. Together, these results show that \textsc{Agon} is pushing research toward a new paradigm: machine scales, human steers.
Stanford HAI