Search papers, labs, and topics across Lattice.
This paper introduces an autoresearch framework where an outer-loop AI agent (researcher) iteratively improves an inner-loop LLM-based policy synthesis system for multi-agent sequential social dilemmas. The researcher agent modifies prompts, feedback functions, and iteration logic of the inner-loop system to optimize for either utilitarian efficiency or Rawlsian maximin. Results show that the autoresearch approach consistently outperforms hand-designed baselines and prompt-only optimization, and interestingly, the discovered pipelines are objective-dependent, with fairness mechanisms only emerging when optimizing for maximin.
Autoresearch reveals that LLMs can discover objective-dependent cooperation strategies in social dilemmas, even injecting fairness mechanisms when explicitly optimizing for maximin welfare.
We study two-level autoresearch for cooperation: an outer-loop AI agent autonomously redesigns the inner-loop pipeline of an LLM policy-synthesis system for multi-agent Sequential Social Dilemmas (SSDs). A researcher agent $\mathcal{R}$ (run as a coding agent) reads the inner-loop source code, edits system prompts, feedback functions, helper libraries, and iteration logic, runs evaluations, and decides what to keep, following the autoresearch paradigm. Across two games (Cleanup and Gathering), two policy-synthesizer LLMs, and two welfare objectives (utilitarian efficiency and Rawlsian maximin), the researcher reliably exceeds hand-designed baselines, sharply tightens run-to-run variance, and outperforms prompt-only optimization. The discovered pipelines are objective-dependent: only under maximin does the researcher inject an explicit fairness mechanism into synthesizer pipelines, a class of mechanism that is absent from its own objective-agnostic system prompt and from every efficiency-optimized pipeline. This supports an information-design reading in which the researcher chooses what to reveal to the boundedly rational synthesizer as a function of the welfare objective. Code at https://github.com/vicgalle/autoresearch-social-dilemmas.
