Search papers, labs, and topics across Lattice.
This study presents a comprehensive multi-method framework for detecting generative AI coding agents within 180 million Git repositories, revealing significant discrepancies in prevalence estimates based on detection methods. By integrating configuration-file scanning, commit-message analysis, author-identity matching, and bot-signature lookup, the research identifies 850,157 Claude Code commits, highlighting a 30x recall gap when relying solely on bot-account lookups. The findings indicate that traditional pull-request censuses miss a substantial portion of AI agent activity, underscoring the necessity for a multi-faceted approach to accurately assess AI's integration into open-source projects.
A staggering 79% of Claude Code adopters are overlooked by traditional pull-request analyses, revealing a critical blind spot in understanding AI's role in open-source development.
Generative AI coding agents are entering the open-source supply chain, yet their diverse and often invisible traces leave their prevalence poorly understood. We introduce a multi-layered detection framework that integrates configuration-file scanning, commit-message analysis, author-identity matching, and bot-signature lookup across World of Code (180M+ Git repositories), classifying agent traces into four behavioral types. No single method captures more than a fraction of activity: multi-method detection identifies 850,157 Claude Code commits in one snapshot, of which bot-account lookup_the signal most adoption studies rely on_recovers only 28,154 (3.3%), a 30x relative-recall gap, so single-signal prevalence estimates are biased low by at least this factor. Every detection pattern is hand-validated (495 labels) with per-cell precision and Wilson confidence intervals. Across snapshots from December 2024 to April 2026, commit-attributed agents generate over 320,000 commits per month; Claude Code leads (886,122 commits across 17,295 projects) and dominates silent, configuration-file-only adoption (21,078 projects). Compared against an independent pull-request census (AIDev), the two channels capture nearly disjoint agent populations_a PR census misses 79% of commit-detected Claude Code adopters and essentially all Codex adopters_and different kinds of work: PR-deployed cloud agents (Codex, Cursor) surface as feature work, while commit-deployed in-editor agents (Claude Code, OpenHands, Aider) surface as maintenance. The observed work profile follows deployment and detection mode rather than the tool itself, so no single channel is representative.
