Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces Agent-Native Research Artifacts (ARAs), a new protocol for scientific publication designed to be machine-executable and capture the full research process, including failures and implementation details often omitted in traditional papers. ARAs consist of four layers: scientific logic, executable code, an exploration graph, and evidence grounding. Experiments on PaperBench and RE-Bench demonstrate that ARAs significantly improve question-answering accuracy and reproduction success compared to traditional papers, while also showing potential limitations in open-ended extension tasks due to the preserved failure traces.
Traditional research papers are costing AI agents reproducibility and understanding, but a new "Agent-Native" format that captures the full messy research process boosts performance by up to 20%.
Scientific publication compresses a branching, iterative research process into a linear narrative, discarding the majority of what was discovered along the way. This compilation imposes two structural costs: a Storytelling Tax, where failed experiments, rejected hypotheses, and the branching exploration process are discarded to fit a linear narrative; and an Engineering Tax, where the gap between reviewer-sufficient prose and agent-sufficient specification leaves critical implementation details unwritten. Tolerable for human readers, these costs become critical when AI agents must understand, reproduce, and extend published work. We introduce the Agent-Native Research Artifact (ARA), a protocol that replaces the narrative paper with a machine-executable research package structured around four layers: scientific logic, executable code with full specifications, an exploration graph that preserves the failures compilation discards, and evidence grounding every claim in raw outputs. Three mechanisms support the ecosystem: a Live Research Manager that captures decisions and dead ends during ordinary development; an ARA Compiler that translates legacy PDFs and repos into ARAs; and an ARA-native review system that automates objective checks so human reviewers can focus on significance, novelty, and taste. On PaperBench and RE-Bench, ARA raises question-answering accuracy from 72.4% to 93.7% and reproduction success from 57.4% to 64.4%. On RE-Bench's five open-ended extension tasks, preserved failure traces in ARA accelerate progress, but can also constrain a capable agent from stepping outside the prior-run box depending on the agent's capabilities.
Stanford HAI
UW