Search papers, labs, and topics across Lattice.
This study evaluates the effectiveness of Single-Agent and Multi-Agent systems in generating README files for GitHub repositories using Retrieval-Augmented Generation (RAG) architectures. The findings reveal that while Single-Agent systems can produce high lexical quality at significantly reduced token consumption and faster speeds, Multi-Agent Systems excel in maintaining structural consistency. Notably, integrating lightweight developer-guided planning enhances overall documentation quality, outperforming all configurations tested, including state-of-the-art baselines.
Single-Agent systems can match the lexical quality of Multi-Agent Systems while slashing token usage by 86% and doubling generation speed.
Large Language Models (LLMs) are increasingly utilized to automate several software engineering tasks, including code completion, code summarization, testing, and the generation of repository-level documentation. While Multi-Agent Systems (MAS) are often adopted to support such tasks under the premise that task decomposition improves performance, the impact of architectural complexity on practical efficiency remains under-examined. This study empirically evaluates Retrieval-Augmented Generation (RAG) dependent architectures for the generation of README files for GitHub repositories. In this work, we conducted a systematic comparison between a Single-Agent pipeline, a specialized MAS, and a developer-guided planning (DevPlan) variant, benchmarked against LARCH -- a state-of-the-art baseline -- and the original ground truth. Results indicate a critical architectural trade-off: the Single-Agent pipeline achieves lexical quality comparable to MAS while reducing token consumption by 86% and operating at twice the speed. In contrast, manual taxonomy analysis demonstrates that MAS achieves high structural consistency (98%), resolving formatting issues observed in single-agent approaches. Autonomous planning is identified as the primary pipeline bottleneck; incorporating lightweight developer-guided plans produces the highest overall documentation quality, surpassing all the analyzed configurations.
