Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces AgenTag, a multimodal framework designed for the open-world attribution of AI coding agents based on behavioral fingerprints. By analyzing a dataset of over 33,000 pull requests, AgenTag achieves a weighted F1 score of 0.96 in identifying authoring agents and reveals that the attribution signal primarily comes from PR descriptions and commit messages rather than code diffs. The findings emphasize that even without explicit markers, latent stylistic characteristics can effectively distinguish AI agents, highlighting the importance of communication style in attribution tasks.
Attribution of AI coding agents is possible even when explicit identifiers are removed, relying instead on their unique communication styles.
AI coding agents increasingly author pull requests (PRs), often under developers' own accounts, obscuring who actually produced a change. Reliable attribution is important for repository governance, empirical studies of AI-assisted software development, and measuring the impact of AI coding agents. Existing work focuses on closed-set identification of known agents, leaving the practical limits of open-world AI coding agent attribution largely unexplored. In this paper, we present AgenTag, a multimodal framework for open-world AI coding agent attribution, evaluated on AIDev, comprising 33,580 PRs from five AI coding agents and 6,618 human-authored PRs. We represent each PR using textual, behavioral, and code-based modalities, and compare conventional classification with supervised contrastive learning for open-set recognition and few-shot enrollment of previously unseen agents. AgenTag identifies authoring agents with a weighted F1 of 0.96 (macro F1 of 0.84), distinguishes AI- from human-authored PRs with a balanced F1 of 0.89, and detects previously unseen agents with an AUC of 0.84. We further show that PR descriptions and commit messages provide nearly all of the attribution signal, whereas code diffs contribute little across multiple representations, indicating that coding agents are distinguished primarily by how they communicate changes rather than by the code they generate. Moreover, these behavioral fingerprints persist after removing explicit self-disclosed markers, demonstrating that attribution relies largely on latent stylistic characteristics. These findings show that reliable attribution of AI coding agents is feasible and clarify the practical trade-offs between attribution accuracy and the information required to achieve it.