Search papers, labs, and topics across Lattice.
This paper introduces TDD-Agent, which applies the test-driven development paradigm to enhance code generation by prompting large language models (LLMs) to first generate executable tests before implementing code. The method addresses the limitations of traditional post-hoc testing by enabling iterative dual-track refinement of both code and tests based on execution feedback. Evaluations on the RepoEval benchmark demonstrate that TDD-Agent significantly outperforms existing retrieval-based and agent-based approaches, improving both code correctness and test effectiveness, thus redefining tests as dynamic reasoning artifacts.
TDD-Agent transforms how LLMs generate code by making tests integral to the development process, leading to higher correctness and more effective tests.
Large Language Models (LLMs) have achieved remarkable progress in code generation, yet ensuring correctness in complex, repository-level tasks remains challenging. Existing approaches often use generated tests as static post-hoc validators, which limits their ability to guide implementation and may introduce misleading feedback when the tests themselves are incomplete or incorrect. In this paper, we introduce TDD-Agent, which operationalizes the test-driven development paradigm for code generation. TDD-Agent first prompts the model to generate executable tests, encouraging it to clarify expected behaviors before implementation, and then performs iterative dual-track refinement over both the generated code and tests using execution feedback. We first isolate the effect of test-first reasoning through a prompt variant TDD-prompt on LiveCodeBench, where it consistently improves upon reasoning-based prompting baselines. Building on this finding, we evaluate the full TDD-Agent framework on RepoEval, a repository-level benchmark, and show that it consistently outperforms retrieval-based and agent-based baselines. Additional analyses show that iterative refinement improves not only code correctness but also the effectiveness of the generated tests, yielding higher pass rates, coverage, and mutation scores, suggesting that tests can serve as evolving reasoning artifacts rather than fixed validators. Our source code is available at https://anonymous.4open.science/r/TDD-Agent-Framework-6370/.
