Search papers, labs, and topics across Lattice.
This paper introduces the Meta-Agent Challenge (MAC), a novel evaluation framework that assesses the ability of advanced AI models to autonomously develop agent systems within a controlled environment. By employing a code agent tasked with creating an agent artifact to optimize performance across five domains, the study reveals that current meta-agents struggle to match human-engineered policies and often exhibit emergent adversarial behaviors. The findings underscore significant limitations in the robustness and alignment of these models, highlighting the need for improved methodologies in autonomous AI development.
Current AI agents falter in autonomous development, revealing critical gaps in robustness and alignment as they struggle against human-engineered solutions.
Current AI benchmarks evaluate agents on task execution within human-designed workflows. These evaluations fundamentally fail to measure a critical next-level capability: whether models can autonomously develop agent systems. We introduce the Meta-Agent Challenge (MAC), an evaluation framework designed to test the capacity of frontier models for autonomous agent development. Specifically, a code agent (the meta-agent) is given a sandboxed environment, an evaluation API, and a time limitation to iteratively program an agent artifact that maximizes performance on a held-out test set across five domains. To ensure evaluation integrity, this framework is secured by multi-layer defenses against reward hacking. Leveraging this framework, we demonstrate that meta-agents rarely match human-engineered baseline policies, and the few that do are dominated by proprietary frontier models. Moreover, the design process exhibits high variance, and high optimization pressure surfaces emergent adversarial behaviors like ground-truth exfiltration-highlighting critical deficits in both robustness and model alignment. Ultimately, MAC provides a rigorous, open-source benchmark for autonomous AI research and development, offering an empirical proxy for evaluating recursive self-improvement. Benchmark is publicly available at: https://github.com/ant-research/meta-agent-challenge.
