Search papers, labs, and topics across Lattice.
This study evaluates role-based multi-agent code generation for large-scale programming tasks by analyzing its performance on 12 Java repositories. The findings reveal that this approach produces code with greater similarity to human-written code compared to single LLMs, though it still falls short of matching human implementation quality. This research highlights the potential of multi-agent systems in enhancing code generation capabilities while identifying areas for further improvement.
Role-based multi-agent code generation narrows the gap between AI-generated and human-written code, but still leaves room for improvement.
Role-based multiagent code generation aims to make LLMs more effective on repository-scale problems, moving beyond small programming tasks. We evaluate this approach on 12 Java repositories, finding greater similarity to developer code than single LLMs, but a persistent gap from human implementations.