Search papers, labs, and topics across Lattice.
This study explores the potential of large language models (LLMs) to replicate the collective accuracy seen in human swarm intelligence by conducting a controlled experiment with 960 prompts across three models: GPT-5, Gemini 2.5 Pro, and Claude Sonnet 4.5. The findings indicate that both intra-model sampling and inter-model aggregation significantly reduce estimation errors, achieving reductions of up to 37 percentage points in mean absolute percentage error (MAPE). Additionally, the observed correlations between confidence interval widths and estimation errors suggest that LLMs exhibit a form of metacognitive awareness regarding uncertainty in their outputs.
LLMs can achieve remarkable error reductions in estimation tasks by leveraging artificial swarm intelligence, outperforming traditional individual model predictions.
Human swarm intelligence demonstrates remarkable collective accuracy but faces scalability constraints in cost, coordination, and time. We investigate whether large language models (LLMs) can approximate swarm intelligence effects through artificial swarms, addressing a critical gap in understanding AI-based aggregation mechanisms. We conducted a controlled experiment with 960 manually executed prompts across three proprietary models (GPT-5, Gemini 2.5 Pro, Claude Sonnet 4.5), testing intra-model sampling and inter-model aggregation on eight estimation tasks. Results reveal consistent error reduction through intra- and inter-model aggregation, with significant error reductions up to 37 percentage points in MAPE across different aggregation strategies. We observed small to large effect sizes for positive correlations (Spearman's $蟻=0.242-0.568$, all $p<0.001$) between relative confidence interval widths and relative estimation errors, suggesting LLMs possess metacognitive awareness when assessing uncertainty. We discuss implications for research and practice, providing actionable insights for deploying LLM swarms in organizational decision-making.
