Search papers, labs, and topics across Lattice.
This paper introduces CoRaCommit, a VS Code extension that improves commit message generation by retrieving similar commit exemplars to provide contextual prompts for large language models (LLMs). By invoking multiple LLMs in parallel and incorporating user feedback for dynamic recommendations, CoRaCommit addresses the limitations of existing tools that rely solely on code diffs. Experimental results indicate that CoRaCommit significantly outperforms current VS Code extensions in generating high-quality commit messages, as measured by various metrics including BLEU and ROUGE-L.
Retrieval-augmented context boosts commit message quality, outperforming traditional LLM approaches by leveraging historical examples and user feedback.
Commit messages are essential textual artifacts that describe the intent behind code changes, and play a critical role in version control, code review, and historical tracking. However, in practice, commit messages are primarily authored manually, which is time-consuming and often results in inconsistent quality and non-uniform expression. Existing VS Code extensions for commit message generation typically directly invoke large language models based on the code diff, without leveraging similar commit exemplars as references, and rarely support user feedback-driven LLM recommendation. To address these limitations, this paper presents CoRaCommit, a VS Code extension that enhances commit message generation by retrieving similar commit exemplars as prompt context, invoking multiple LLMs in parallel for candidate commit message comparison, and dynamically recommending LLMs based on user feedback. Experimental results on 945 commits from the ApacheCM dataset show that CoRaCommit outperforms existing VS Code extensions across BLEU, CIDEr, METEOR, and ROUGE-L metrics, demonstrating the effectiveness of retrieval-augmented context for commit message generation.
